Sep 07 09:37:50 devstack cinder-volume[76302]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 09:37:50 devstack cinder-volume[76302]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:37:50 devstack cinder-volume[76302]: we strongly recommend against using it for new projects. Sep 07 09:37:50 devstack cinder-volume[76302]: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:37:50 devstack cinder-volume[76302]: framework. For more detail see Sep 07 09:37:50 devstack cinder-volume[76302]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:37:50 devstack cinder-volume[76302]: import eventlet # noqa Sep 07 09:37:52 devstack cinder-volume[76302]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:37:52 devstack cinder-volume[76302]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:37:52 devstack cinder-volume[76302]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:37:54 devstack cinder-volume[76302]: INFO dbcounter [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Registered counter for database cinder Sep 07 09:37:54 devstack cinder-volume[76302]: DEBUG oslo_db.sqlalchemy.engines [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76302) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:37:54 devstack cinder-volume[76302]: DEBUG dbcounter [-] [76302] Writer thread running {{(pid=76302) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:37:54 devstack cinder-volume[76302]: INFO cinder.rpc [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 09:37:54 devstack cinder-volume[76302]: INFO cinder.rpc [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 09:37:54 devstack cinder-volume[76302]: DEBUG oslo_db.sqlalchemy.engines [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76302) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:37:54 devstack cinder-volume[76302]: INFO cinder.volume.manager [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Determined volume DB was empty at startup. Sep 07 09:37:54 devstack cinder-volume[76302]: DEBUG cinder.volume.manager [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76302) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 09:37:54 devstack cinder-volume[76302]: INFO cinder.volume.manager [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 09:37:54 devstack cinder-volume[76302]: WARNING stevedore.named [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:37:54 devstack cinder-volume[76302]: WARNING castellan.key_manager [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:37:54 devstack cinder-volume[76302]: WARNING cinder.keymgr.conf_key_mgr [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:37:54 devstack cinder-volume[76302]: DEBUG cinder.volume.drivers.lvm [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76302) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 09:37:54 devstack cinder-volume[76302]: DEBUG oslo_concurrency.processutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_concurrency.processutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] CMD "cinder-rtstool verify" returned: 0 in 0.472s {{(pid=76302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_db.sqlalchemy.engines [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76302) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:37:55 devstack cinder-volume[76302]: INFO cinder.rpc [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 09:37:55 devstack cinder-volume[76302]: INFO cinder.rpc [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 09:37:55 devstack cinder-volume[76302]: WARNING stevedore.named [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:37:55 devstack cinder-volume[76302]: WARNING castellan.key_manager [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:37:55 devstack cinder-volume[76302]: INFO cinder.volume.manager [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_db.sqlalchemy.engines [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76302) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:37:55 devstack cinder-volume[76302]: INFO oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Starting 1 workers Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Started child 76553 {{(pid=76302) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Full set of CONF: {{(pid=76302) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] ******************************************************************************** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Configuration options gathered from: {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] ================================================================================ {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] allow_availability_zone_fallback = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] allow_compression_on_image_upload = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] allowed_direct_url_schemes = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] api_rate_limit = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] auth_strategy = keystone {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] az_cache_duration = 3600 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_availability_zone = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_host = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_stats_polling_interval = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backup_api_class = cinder.backup.api.API {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76553]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backup_name_template = backup-%s {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backup_use_same_host = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backup_use_temp_snapshot = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] chap_password = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] chap_username = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_internal_tenant_project_id = 20578c589c9f4d689e92014258cd88d0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_internal_tenant_user_id = 72d4aa63cab4497b9acfc601c2c226f9 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cloned_volume_same_az = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cluster = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] compression_format = gzip {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] compute_api_class = cinder.compute.nova.API {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] config_dir = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] config_source = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] control_exchange = openstack {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] debug = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] default_availability_zone = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] default_group_type = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] default_volume_type = lvmdriver-1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] disk_geometry = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] driver_client_cert = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] driver_client_cert_key = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] driver_data_namespace = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] driver_ssl_cert_path = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] driver_ssl_cert_verify = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] driver_use_ssl = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] enable_force_upload = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] enable_new_services = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] enable_unsupported_driver = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] enforce_multipath_for_image_xfer = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] filter_function = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_api_insecure = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_api_ssl_compression = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_ca_certificates_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_catalog_info = image:glance:publicURL {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_num_retries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance_request_timeout = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] goodness_function = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] graceful_shutdown_timeout = 5 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] group_api_class = cinder.group.api.API {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] host = devstack {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_compress_on_upload = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_conversion_address_space_limit = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_conversion_cpu_limit = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_conversion_disable = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_upload_use_cinder_backend = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_upload_use_internal_tenant = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_volume_cache_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_volume_cache_max_count = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] image_volume_cache_max_size_gb = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] init_host_max_objects_retrieval = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] instance_format = [instance: %(uuid)s] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] iscsi_target_flags = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] iscsi_write_cache = on {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76553]: INFO cinder.volume.manager [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 09:37:55 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] iser_helper = tgtadm {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] iser_ip_address = 192.168.122.65 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] iser_port = 3260 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_color = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_config_append = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_dir = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_options = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_rotate_interval = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_rotate_interval_type = days {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] log_rotation_type = none {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] max_age = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] max_logfile_count = 30 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] max_logfile_size_mb = 200 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] max_over_subscription_ratio = 20.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] message_reap_interval = 86400 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] message_ttl = 2592000 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:55 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] migration_create_volume_timeout_secs = 300 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] monkey_patch = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] monkey_patch_modules = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] my_ip = 192.168.122.65 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] no_snapshot_gb_quota = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] num_iser_scan_tries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] num_shell_tries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] num_volume_device_scan_tries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] nvmeof_conn_info_version = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] nvmet_ns_id = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] nvmet_port_id = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] osapi_max_limit = 1000 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] osapi_volume_ext_list = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] osapi_volume_listen_port = 8776 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] osapi_volume_use_ssl = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] osapi_volume_workers = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] per_volume_size_limit = -1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] periodic_fuzzy_delay = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] periodic_interval = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] public_endpoint = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] publish_errors = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] quota_backup_gigabytes = 1000 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] quota_backups = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] quota_gigabytes = 1000 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] quota_groups = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] quota_snapshots = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] quota_volumes = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] rate_limit_burst = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] rate_limit_except_level = CRITICAL {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] rate_limit_interval = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] reinit_driver_count = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] replication_device = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] report_discard_supported = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] report_interval = 120 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] reservation_clean_interval = 86400 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] reservation_expire = 86400 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] reserved_image_namespaces = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] reserved_percentage = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] rpc_response_timeout = 120 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] run_external_periodic_tasks = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:55 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] scst_target_driver = iscsi {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] scst_target_iqn_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_down_time = 720 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] shell_completion = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] snapshot_name_template = snapshot-%s {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] snapshot_same_host = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] split_loggers = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] state_path = /opt/stack/data/cinder {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] storage_availability_zone = nova {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] storage_protocol = iSCSI {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] syslog_log_facility = LOG_USER {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] target_helper = lioadm {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] target_ip_address = 192.168.122.65 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] target_port = 3260 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] target_protocol = iscsi {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] target_secondary_ip_addresses = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] trace_flags = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] transport_url = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] until_refresh = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] use_chap_auth = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] use_default_quota_class = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] use_journal = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] use_json = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] use_multipath_for_image_xfer = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] use_stderr = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] use_syslog = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] verify_glance_signatures = enabled {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_api_class = cinder.volume.api.API {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_backend_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_clear = zero {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_clear_ionice = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_clear_size = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_copy_bps_limit = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_dd_blocksize = 1M {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_name_template = volume-%s {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:55 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_service_inithost_offload = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volume_usage_audit_period = month {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] zoning_mode = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_concurrency.disable_process_locking = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.auth_section = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.auth_type = password {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.auth_version = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.cache = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.include_service_catalog = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.insecure = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.interface = public {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_password = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcache_username = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack sudo[76606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 09:37:55 devstack sudo[76606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.region_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.service_type = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.backend = dogpile.cache.null {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.backend_argument = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.backend_expiration_time = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.config_prefix = cache.oslo {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.debug_cache_backend = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.enable_retry_client = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.enable_socket_keepalive = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.expiration_time = 600 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.hashclient_retry_attempts = 2 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.memcache_dead_retry = 300 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.memcache_pool_maxsize = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.memcache_sasl_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.password = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.proxies = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.redis_db = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.redis_server = localhost:6379 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.retry_attempts = 2 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.retry_delay = 0.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.socket_keepalive_count = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.socket_keepalive_idle = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.socket_keepalive_interval = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.socket_timeout = 1.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.tls_allowed_ciphers = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.tls_cafile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.tls_certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.tls_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.tls_keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cache.username = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] coordination.backend_url = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.asyncio_connection = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.asyncio_slave_connection = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.backend = sqlalchemy {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.connection = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.connection_debug = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.connection_parameters = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.connection_recycle_time = 3600 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.connection_trace = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.db_inc_retry_interval = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.db_max_retries = 20 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.db_max_retry_interval = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.db_retry_interval = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.max_overflow = 50 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.max_pool_size = 5 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.max_retries = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.mysql_wsrep_sync_wait = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.pool_timeout = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.retry_interval = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.slave_connection = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.sqlite_synchronous = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.synchronous_reader = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] database.use_db_reconnect = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_tracing.insecure = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.connection_string = messaging:// {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.es_doc_type = notification {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.es_scroll_size = 10000 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.es_scroll_time = 2m {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.filter_error_trace = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.hmac_keys = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.sentinel_service_name = mymaster {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.socket_timeout = 0.1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.trace_requests = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler.trace_sqlalchemy = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler_jaeger.process_tags = {} {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler_jaeger.service_name_prefix = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] profiler_otlp.service_name_prefix = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.enforce_new_defaults = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.policy_default_rule = default {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.policy_file = policy.yaml {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] privsep_osbrick.group = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] privsep_osbrick.helper_command = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] privsep_osbrick.user = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_sys_admin.group = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_sys_admin.helper_command = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] cinder_sys_admin.user = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.auth_section = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.auth_type = password {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.cafile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.collect_timing = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.insecure = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.send_service_user_token = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.split_loggers = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.timeout = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.tls_ciphers = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] service_user.tls_min_version = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.auth_section = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.auth_type = password {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.collect_timing = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.insecure = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.region_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.split_loggers = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.timeout = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.tls_ciphers = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] glance.tls_min_version = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.backend_availability_zone = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.chap_password = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.chap_username = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.disk_geometry = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.driver_client_cert = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.driver_client_cert_key = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.driver_data_namespace = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.driver_use_ssl = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.extra_capabilities = {} {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.filter_function = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.goodness_function = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.iscsi_target_flags = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.iscsi_write_cache = on {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.iser_helper = tgtadm {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.iser_port = 3260 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.lvm_share_target = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.lvm_type = auto {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.num_shell_tries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.replication_device = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.report_discard_supported = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.reserved_percentage = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.target_helper = tgtadm {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.target_port = 3260 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.target_protocol = iscsi {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.trace_flags = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.unique_fqdn_network = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.use_chap_auth = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_backend_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_clear = zero {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_clear_ionice = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_clear_size = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_reports.file_event_handler = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_reports.log_dir = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.backend_host = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.chap_password = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.chap_username = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.disk_geometry = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.driver_client_cert = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.extra_capabilities = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.filter_function = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.goodness_function = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.iser_helper = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.iser_ip_address = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.iser_port = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.lvm_share_target = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.lvm_type = auto {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.num_shell_tries = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.replication_device = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.report_discard_supported = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.reserved_percentage = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.scst_target_driver = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.storage_protocol = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.target_helper = lioadm {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.target_ip_address = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.target_port = 3260 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.trace_flags = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.use_chap_auth = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_clear = zero {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_clear_size = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] lvmdriver-1.volumes_dir = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.ssl = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_notifications.driver = [] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_notifications.retry = -1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] key_manager.fixed_key = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.barbican_api_version = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.barbican_endpoint = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.barbican_endpoint_type = public {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.barbican_region_name = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.cafile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.collect_timing = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.insecure = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.number_of_retries = 60 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.retry_delay = 1 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.send_service_user_token = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.split_loggers = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.timeout = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.tls_ciphers = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.tls_min_version = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.verify_ssl = True {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican.verify_ssl_path = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.auth_section = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.auth_type = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.cafile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.certfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.collect_timing = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.insecure = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.keyfile = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.split_loggers = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.timeout = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.tls_ciphers = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] barbican_service_user.tls_min_version = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.approle_role_id = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.approle_secret_id = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.auth_method = approle {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.auth_path = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.kv_mountpoint = secret {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.kv_path = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.kv_version = 2 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.namespace = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.root_token_id = **** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.ssl_ca_crt_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.timeout = 60.0 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.token_file = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.token_role = None {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.use_ssl = False {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:37:55 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] ******************************************************************************** {{(pid=76302) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 09:37:56 devstack sudo[76606]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:56 devstack sudo[76694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:37:56 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:56 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.303s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:37:56 devstack cinder-volume[76553]: INFO cinder.brick.local_dev.lvm [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:56 devstack sudo[76786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:37:56 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:56 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG cinder.brick.local_dev.lvm [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76553) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 09:37:56 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:56 devstack sudo[76867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:37:56 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:57 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.549s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:57 devstack sudo[77078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:37:57 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:57 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.334s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:57 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 09:37:57 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:57 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.283s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:57 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:57 devstack sudo[77174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:37:57 devstack sudo[77174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:58 devstack sudo[77174]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:58 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:58 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:58 devstack sudo[77203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:37:58 devstack sudo[77203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:58 devstack sudo[77203]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:58 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:58 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:58 devstack sudo[77229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:37:58 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:58 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:58 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:58 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:58 devstack sudo[77296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:37:58 devstack sudo[77296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:59 devstack sudo[77296]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:59 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:37:59 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:59 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:59 devstack cinder-volume[76553]: INFO cinder.volume.drivers.lvm [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:59 devstack sudo[77304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:37:59 devstack sudo[77304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:59 devstack sudo[77304]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG cinder.volume.drivers.lvm [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Updating volume stats {{(pid=76553) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:59 devstack sudo[77313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:37:59 devstack sudo[77313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:37:59 devstack sudo[77313]: pam_unix(sudo:session): session closed for user root Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:37:59 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:37:59 devstack sudo[77316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:37:59 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:00 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:00 devstack sudo[77319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:38:00 devstack sudo[77319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:00 devstack sudo[77319]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:00 devstack sudo[77322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:38:00 devstack sudo[77322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:00 devstack sudo[77322]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:00 devstack cinder-volume[76553]: INFO cinder.volume.driver [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Driver hasn't implemented _init_vendor_properties() Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG cinder.volume.driver [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76553) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76553) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG dbcounter [-] [76553] Writer thread running {{(pid=76553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG cinder.db.api [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Building query based on filter {{(pid=76553) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG cinder.image.image_utils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76553) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 09:38:00 devstack cinder-volume[76553]: INFO cinder.keymgr.migration [None req-5b3962ea-bb80-4e0f-8c14-e9e88cdac2a0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG cinder.volume.drivers.lvm [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Updating volume stats {{(pid=76553) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:38:00 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:00 devstack sudo[77327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:38:00 devstack sudo[77327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:01 devstack sudo[77327]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:01 devstack sudo[77330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:38:01 devstack sudo[77330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:01 devstack sudo[77330]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:01 devstack sudo[77333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:38:01 devstack sudo[77333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:01 devstack sudo[77333]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:01 devstack sudo[77336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:38:01 devstack sudo[77336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:01 devstack sudo[77336]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:01 devstack cinder-volume[76553]: DEBUG cinder.manager [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Notifying Schedulers of capabilities ... {{(pid=76553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:38:02 devstack cinder-volume[76553]: INFO cinder.volume.manager [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Driver initialization completed successfully. Sep 07 09:38:02 devstack cinder-volume[76553]: INFO cinder.manager [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Initiating service 2 cleanup Sep 07 09:38:02 devstack cinder-volume[76553]: INFO cinder.manager [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Service 2 cleanup completed. Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG cinder.service [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Creating RPC server for service cinder-volume {{(pid=76553) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG cinder.service [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76553) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 09:38:02 devstack cinder-volume[76553]: INFO cinder.volume.manager [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG cinder.volume.drivers.lvm [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Updating volume stats {{(pid=76553) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:02 devstack sudo[77342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:38:02 devstack sudo[77342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:02 devstack sudo[77342]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:02 devstack sudo[77345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:38:02 devstack sudo[77345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:02 devstack sudo[77345]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:02 devstack sudo[77348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:38:02 devstack sudo[77348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:02 devstack sudo[77348]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:02 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:38:02 devstack sudo[77354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:38:02 devstack sudo[77354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:38:03 devstack sudo[77354]: pam_unix(sudo:session): session closed for user root Sep 07 09:38:03 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:38:03 devstack cinder-volume[76553]: INFO cinder.volume.manager [None req-7cb53fdb-a100-4572-b7dd-a76e76d4d99d None None] Driver post RPC initialization completed successfully. Sep 07 09:38:04 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager._thread_info {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:38:04 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread count: 6 {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:38:04 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread info: [<_MainThread(MainThread, started 126810265960576)>, , , , , ] {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:38:05 devstack cinder-volume[76302]: DEBUG dbcounter [-] [76302] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76302) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:38:13 devstack cinder-volume[76553]: DEBUG dbcounter [-] [76553] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:38:13 devstack cinder-volume[76553]: DEBUG dbcounter [-] [76553] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:39:04 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:39:04 devstack cinder-volume[76553]: DEBUG cinder.volume.drivers.lvm [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Updating volume stats {{(pid=76553) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:39:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:39:04 devstack sudo[79379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:39:04 devstack sudo[79379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:39:04 devstack sudo[79379]: pam_unix(sudo:session): session closed for user root Sep 07 09:39:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:39:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:39:04 devstack sudo[79382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:39:04 devstack sudo[79382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:39:04 devstack sudo[79382]: pam_unix(sudo:session): session closed for user root Sep 07 09:39:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:39:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:39:04 devstack sudo[79385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:39:04 devstack sudo[79385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:39:05 devstack sudo[79385]: pam_unix(sudo:session): session closed for user root Sep 07 09:39:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:39:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:39:05 devstack sudo[79388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:39:05 devstack sudo[79388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:39:05 devstack sudo[79388]: pam_unix(sudo:session): session closed for user root Sep 07 09:39:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:39:05 devstack cinder-volume[76553]: DEBUG cinder.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Notifying Schedulers of capabilities ... {{(pid=76553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:39:05 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager._thread_info {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:39:05 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread count: 6 {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:39:05 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread info: [<_MainThread(MainThread, started 126810265960576)>, , , , , ] {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:40:04 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:40:04 devstack cinder-volume[76553]: DEBUG cinder.volume.drivers.lvm [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Updating volume stats {{(pid=76553) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:40:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:40:04 devstack sudo[82724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:40:04 devstack sudo[82724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:40:04 devstack sudo[82724]: pam_unix(sudo:session): session closed for user root Sep 07 09:40:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:40:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:40:04 devstack sudo[82729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:40:04 devstack sudo[82729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:40:04 devstack sudo[82729]: pam_unix(sudo:session): session closed for user root Sep 07 09:40:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:40:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:40:04 devstack sudo[82732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:40:04 devstack sudo[82732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:40:05 devstack sudo[82732]: pam_unix(sudo:session): session closed for user root Sep 07 09:40:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:40:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:40:05 devstack sudo[82735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:40:05 devstack sudo[82735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:40:05 devstack sudo[82735]: pam_unix(sudo:session): session closed for user root Sep 07 09:40:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:40:05 devstack cinder-volume[76553]: DEBUG cinder.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Notifying Schedulers of capabilities ... {{(pid=76553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:40:13 devstack cinder-volume[76553]: DEBUG dbcounter [-] [76553] Writing DB stats cinder:SELECT=1 {{(pid=76553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:40:13 devstack cinder-volume[76553]: DEBUG dbcounter [-] [76553] Writing DB stats cinder:UPDATE=1 {{(pid=76553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:41:04 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:41:04 devstack cinder-volume[76553]: DEBUG cinder.volume.drivers.lvm [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Updating volume stats {{(pid=76553) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:41:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:41:04 devstack sudo[84770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:41:04 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:41:04 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root Sep 07 09:41:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:41:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:41:04 devstack sudo[84773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:41:04 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:41:04 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root Sep 07 09:41:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:41:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:41:04 devstack sudo[84779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:41:04 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:41:05 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root Sep 07 09:41:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:41:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:41:05 devstack sudo[84782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:41:05 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:41:05 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root Sep 07 09:41:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:41:05 devstack cinder-volume[76553]: DEBUG cinder.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Notifying Schedulers of capabilities ... {{(pid=76553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:41:05 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager._thread_info {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:41:05 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread count: 6 {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:41:05 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread info: [<_MainThread(MainThread, started 126810265960576)>, , , , , ] {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:42:04 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:42:04 devstack cinder-volume[76553]: DEBUG cinder.volume.drivers.lvm [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Updating volume stats {{(pid=76553) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:42:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:04 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:42:04 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:04 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:04 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:42:04 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:04 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:04 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:04 devstack sudo[86009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:42:04 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:05 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:05 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:42:05 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:05 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:05 devstack cinder-volume[76553]: DEBUG oslo_concurrency.processutils [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76553) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:05 devstack cinder-volume[76553]: DEBUG cinder.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Notifying Schedulers of capabilities ... {{(pid=76553) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:42:05 devstack cinder-volume[76553]: DEBUG oslo_service.periodic_task [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] Running periodic task VolumeManager._thread_info {{(pid=76553) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:42:05 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread count: 6 {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:42:05 devstack cinder-volume[76553]: DEBUG cinder.volume.manager [None req-71d66bf5-a7d6-4d36-8992-a83b92b46501 None None] thread info: [<_MainThread(MainThread, started 126810265960576)>, , , , , ] {{(pid=76553) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:42:13 devstack cinder-volume[76553]: DEBUG dbcounter [-] [76553] Writing DB stats cinder:SELECT=1 {{(pid=76553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:42:13 devstack cinder-volume[76553]: DEBUG dbcounter [-] [76553] Writing DB stats cinder:UPDATE=1 {{(pid=76553) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:42:24 devstack cinder-volume[76302]: INFO oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Caught SIGTERM, stopping children Sep 07 09:42:24 devstack cinder-volume[76302]: DEBUG oslo_concurrency.lockutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Acquiring lock "singleton_lock" {{(pid=76302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:42:24 devstack cinder-volume[76302]: DEBUG oslo_concurrency.lockutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Acquired lock "singleton_lock" {{(pid=76302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:42:24 devstack cinder-volume[76302]: DEBUG oslo_concurrency.lockutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Releasing lock "singleton_lock" {{(pid=76302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:42:24 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Stop services. {{(pid=76302) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 09:42:24 devstack cinder-volume[76302]: DEBUG oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Killing children. {{(pid=76302) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 09:42:24 devstack cinder-volume[76302]: INFO oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Waiting on 1 children to exit Sep 07 09:42:27 devstack cinder-volume[76553]: DEBUG oslo_concurrency.lockutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Acquiring lock "singleton_lock" {{(pid=76553) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:42:27 devstack cinder-volume[76553]: DEBUG oslo_concurrency.lockutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Acquired lock "singleton_lock" {{(pid=76553) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:42:27 devstack cinder-volume[76553]: DEBUG oslo_concurrency.lockutils [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Releasing lock "singleton_lock" {{(pid=76553) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:42:27 devstack cinder-volume[76553]: WARNING amqp [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:42:27 devstack cinder-volume[76553]: WARNING amqp [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:42:27 devstack cinder-volume[76302]: INFO oslo_service.backend._eventlet.service [None req-47d56b95-01f9-4d44-8607-9a6dd1d2b201 None None] Child 76553 exited with status 0 Sep 07 09:42:27 devstack cinder-volume[86492]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 09:42:27 devstack cinder-volume[86492]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:42:27 devstack cinder-volume[86492]: we strongly recommend against using it for new projects. Sep 07 09:42:27 devstack cinder-volume[86492]: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:42:27 devstack cinder-volume[86492]: framework. For more detail see Sep 07 09:42:27 devstack cinder-volume[86492]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:42:27 devstack cinder-volume[86492]: import eventlet # noqa Sep 07 09:42:29 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:42:29 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:42:29 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:42:30 devstack cinder-volume[86492]: INFO dbcounter [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Registered counter for database cinder Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_db.sqlalchemy.engines [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86492) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG dbcounter [-] [86492] Writer thread running {{(pid=86492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:42:30 devstack cinder-volume[86492]: INFO cinder.rpc [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 09:42:30 devstack cinder-volume[86492]: INFO cinder.rpc [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_db.sqlalchemy.engines [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86492) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:30 devstack cinder-volume[86492]: INFO cinder.volume.manager [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Determined volume DB was empty at startup. Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG cinder.volume.manager [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86492) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 09:42:30 devstack cinder-volume[86492]: INFO cinder.volume.manager [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 09:42:30 devstack cinder-volume[86492]: WARNING stevedore.named [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:42:30 devstack cinder-volume[86492]: WARNING castellan.key_manager [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:42:30 devstack cinder-volume[86492]: WARNING cinder.keymgr.conf_key_mgr [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:42:30 devstack cinder-volume[86492]: INFO cinder.volume.manager [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_db.sqlalchemy.engines [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86492) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:30 devstack cinder-volume[86492]: INFO oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Starting 1 workers Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Started child 86708 {{(pid=86492) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Full set of CONF: {{(pid=86492) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] ******************************************************************************** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Configuration options gathered from: {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] ================================================================================ {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] allow_availability_zone_fallback = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] allow_compression_on_image_upload = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] allowed_direct_url_schemes = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] api_rate_limit = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] auth_strategy = keystone {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_availability_zone = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_host = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_stats_polling_interval = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backup_api_class = cinder.backup.api.API {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backup_name_template = backup-%s {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backup_use_same_host = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backup_use_temp_snapshot = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] chap_password = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] chap_username = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_internal_tenant_project_id = 20578c589c9f4d689e92014258cd88d0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_internal_tenant_user_id = 72d4aa63cab4497b9acfc601c2c226f9 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cluster = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] compression_format = gzip {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] compute_api_class = cinder.compute.nova.API {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] config_dir = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] config_source = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] control_exchange = openstack {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] debug = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] default_availability_zone = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] default_group_type = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] default_volume_type = QuobyteHD {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] disk_geometry = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] driver_client_cert = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] driver_client_cert_key = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] driver_data_namespace = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] driver_ssl_cert_path = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86708]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] driver_ssl_cert_verify = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] driver_use_ssl = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] enable_new_services = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] enable_unsupported_driver = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] enabled_backends = ['QuobyteHD'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] enforce_multipath_for_image_xfer = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] filter_function = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_api_insecure = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_api_ssl_compression = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_ca_certificates_file = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_catalog_info = image:glance:publicURL {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_num_retries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance_request_timeout = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] goodness_function = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] graceful_shutdown_timeout = 5 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] group_api_class = cinder.group.api.API {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] host = devstack {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_compress_on_upload = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_conversion_address_space_limit = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_conversion_cpu_limit = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_conversion_disable = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_upload_use_cinder_backend = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_upload_use_internal_tenant = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_volume_cache_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_volume_cache_max_count = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] image_volume_cache_max_size_gb = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] init_host_max_objects_retrieval = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] instance_format = [instance: %(uuid)s] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] iscsi_target_flags = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] iscsi_write_cache = on {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] iser_helper = tgtadm {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] iser_ip_address = 192.168.122.65 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] iser_port = 3260 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_color = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_config_append = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_dir = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_file = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_options = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_rotate_interval = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_rotate_interval_type = days {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] log_rotation_type = none {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] max_age = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] max_logfile_count = 30 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] max_logfile_size_mb = 200 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] max_over_subscription_ratio = 20.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] message_reap_interval = 86400 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] message_ttl = 2592000 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] migration_create_volume_timeout_secs = 300 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] monkey_patch = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] monkey_patch_modules = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] my_ip = 192.168.122.65 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] no_snapshot_gb_quota = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] num_iser_scan_tries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] num_shell_tries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] num_volume_device_scan_tries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] nvmeof_conn_info_version = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] nvmet_ns_id = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] nvmet_port_id = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] osapi_max_limit = 1000 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] osapi_volume_ext_list = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] osapi_volume_listen_port = 8776 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] osapi_volume_use_ssl = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] osapi_volume_workers = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] per_volume_size_limit = -1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] periodic_fuzzy_delay = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] periodic_interval = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] public_endpoint = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] publish_errors = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] quota_backup_gigabytes = 1000 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] quota_backups = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] quota_gigabytes = 1000 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] quota_groups = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] quota_snapshots = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] quota_volumes = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] rate_limit_burst = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] rate_limit_except_level = CRITICAL {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] rate_limit_interval = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] reinit_driver_count = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] replication_device = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] report_discard_supported = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] report_interval = 120 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] reservation_clean_interval = 86400 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] reservation_expire = 86400 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] reserved_image_namespaces = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] reserved_percentage = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] rpc_response_timeout = 120 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] run_external_periodic_tasks = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] scst_target_driver = iscsi {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] scst_target_iqn_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_down_time = 720 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] shell_completion = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] snapshot_name_template = snapshot-%s {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] split_loggers = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] state_path = /opt/stack/data/cinder {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] storage_availability_zone = nova {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] storage_protocol = iSCSI {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] syslog_log_facility = LOG_USER {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] target_helper = lioadm {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] target_ip_address = 192.168.122.65 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] target_port = 3260 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] target_protocol = iscsi {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] target_secondary_ip_addresses = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] trace_flags = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] transport_url = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] until_refresh = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] use_chap_auth = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] use_default_quota_class = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] use_journal = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] use_json = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] use_multipath_for_image_xfer = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] use_stderr = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] use_syslog = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] verify_glance_signatures = enabled {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_api_class = cinder.volume.api.API {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_backend_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_clear = zero {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_clear_ionice = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_clear_size = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_copy_bps_limit = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_dd_blocksize = 1M {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_name_template = volume-%s {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_service_inithost_offload = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volume_usage_audit_period = month {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] zoning_mode = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_concurrency.disable_process_locking = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.auth_section = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.auth_type = password {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.auth_version = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.cache = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.include_service_catalog = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.insecure = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.interface = public {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_password = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcache_username = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.region_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.service_type = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.backend = dogpile.cache.null {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.backend_argument = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.backend_expiration_time = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.config_prefix = cache.oslo {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.debug_cache_backend = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.enable_retry_client = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.enable_socket_keepalive = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.expiration_time = 600 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.hashclient_retry_attempts = 2 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.memcache_dead_retry = 300 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.memcache_pool_maxsize = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.memcache_sasl_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.password = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.proxies = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.redis_db = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.redis_server = localhost:6379 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.retry_attempts = 2 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.retry_delay = 0.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.socket_keepalive_count = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.socket_keepalive_idle = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.socket_keepalive_interval = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.socket_timeout = 1.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.tls_allowed_ciphers = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.tls_cafile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.tls_certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.tls_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.tls_keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cache.username = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] coordination.backend_url = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.asyncio_connection = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.asyncio_slave_connection = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.backend = sqlalchemy {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.connection = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:30 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.connection_debug = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.connection_parameters = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.connection_recycle_time = 3600 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.connection_trace = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.db_inc_retry_interval = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.db_max_retries = 20 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.db_max_retry_interval = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.db_retry_interval = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.max_overflow = 50 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.max_pool_size = 5 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.max_retries = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.mysql_wsrep_sync_wait = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.pool_timeout = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.retry_interval = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.slave_connection = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.sqlite_synchronous = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.synchronous_reader = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] database.use_db_reconnect = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_tracing.insecure = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.connection_string = messaging:// {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.es_doc_type = notification {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.es_scroll_size = 10000 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.es_scroll_time = 2m {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.filter_error_trace = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.hmac_keys = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.sentinel_service_name = mymaster {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.socket_timeout = 0.1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.trace_requests = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler.trace_sqlalchemy = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler_jaeger.process_tags = {} {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler_jaeger.service_name_prefix = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] profiler_otlp.service_name_prefix = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.enforce_new_defaults = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.policy_default_rule = default {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.policy_file = policy.yaml {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] privsep_osbrick.group = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] privsep_osbrick.helper_command = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86708]: INFO cinder.volume.manager [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.remotefs [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86708) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] privsep_osbrick.user = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_sys_admin.group = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_sys_admin.helper_command = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] cinder_sys_admin.user = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.auth_section = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.auth_type = password {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.cafile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.collect_timing = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.insecure = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.send_service_user_token = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.split_loggers = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.timeout = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.tls_ciphers = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] service_user.tls_min_version = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.auth_section = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.auth_type = password {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.collect_timing = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.insecure = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.region_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.split_loggers = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.timeout = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.tls_ciphers = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] glance.tls_min_version = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.backend_availability_zone = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.chap_password = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.chap_username = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.disk_geometry = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.driver_client_cert = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.driver_client_cert_key = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.driver_data_namespace = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.driver_use_ssl = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.extra_capabilities = {} {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.filter_function = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.goodness_function = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.iscsi_target_flags = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.iscsi_write_cache = on {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.iser_helper = tgtadm {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.iser_port = 3260 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_host = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_login = admin {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_mount_options = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_password = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_private_key = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_share_path = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.num_shell_tries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.quobyte_volume_url = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.replication_device = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.report_discard_supported = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.reserved_percentage = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.target_helper = tgtadm {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.target_port = 3260 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.target_protocol = iscsi {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.trace_flags = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.unique_fqdn_network = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.use_chap_auth = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_backend_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_clear = zero {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_clear_ionice = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_clear_size = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_reports.file_event_handler = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_reports.log_dir = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.backend_availability_zone = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.backend_host = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.chap_password = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.chap_username = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.chiscsi_conf = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.disk_geometry = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.driver_client_cert = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.driver_data_namespace = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.driver_use_ssl = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.extra_capabilities = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.filter_function = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.goodness_function = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.iser_helper = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.iser_ip_address = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.iser_port = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.iser_target_prefix = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_host = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_login = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_mount_options = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_password = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_private_key = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_share_path = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_ssh_port = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.num_shell_tries = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.nvmet_port_id = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86708) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 09:42:31 devstack cinder-volume[86708]: WARNING cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 09:42:31 devstack cinder-volume[86708]: WARNING cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.replication_device = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.report_discard_supported = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.reserved_percentage = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Running cmd (subprocess): mount.quobyte {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.scst_target_driver = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.storage_protocol = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.target_helper = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.target_ip_address = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.target_port = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.target_prefix = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.target_protocol = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.trace_flags = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.use_chap_auth = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_clear = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_clear_size = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] QuobyteHD.volumes_dir = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.ssl = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_notifications.driver = [] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_notifications.retry = -1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] key_manager.fixed_key = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.barbican_api_version = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.barbican_endpoint = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.barbican_endpoint_type = public {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.barbican_region_name = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.cafile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.collect_timing = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.insecure = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.number_of_retries = 60 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.retry_delay = 1 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.send_service_user_token = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.split_loggers = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.timeout = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.tls_ciphers = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.tls_min_version = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.verify_ssl = True {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican.verify_ssl_path = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.auth_section = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.auth_type = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.cafile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.certfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.collect_timing = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.insecure = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.keyfile = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.split_loggers = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.timeout = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.tls_ciphers = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] barbican_service_user.tls_min_version = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.approle_role_id = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.approle_secret_id = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.auth_method = approle {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.auth_path = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.kv_mountpoint = secret {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.kv_path = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.kv_version = 2 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.namespace = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.root_token_id = **** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.ssl_ca_crt_file = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.timeout = 60.0 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.token_file = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.token_role = None {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.use_ssl = False {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:31 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] ******************************************************************************** {{(pid=86492) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 09:42:31 devstack quobyte-client[86709]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 09:42:31 devstack quobyte-client[86709]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] CMD "mount.quobyte" returned: 1 in 0.100s {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=86708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:42:31 devstack cinder-volume[86708]: INFO cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 ... Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 -c /etc/quobyte/client-cinder.cfg {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:31 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 -c /etc/quobyte/client-cinder.cfg Sep 07 09:42:31 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:31 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.391s {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:31 devstack cinder-volume[86708]: INFO cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 succeeded Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=86708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.404s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:31 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:42:31 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:31 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.241s {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:31 devstack cinder-volume[86708]: INFO cinder.volume.driver [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Driver hasn't implemented _init_vendor_properties() Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG cinder.volume.driver [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6140975952148, 'free_capacity_gb': 1773.6140975952148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86708) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG oslo_db.sqlalchemy.engines [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG dbcounter [-] [86708] Writer thread running {{(pid=86708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:42:31 devstack cinder-volume[86708]: DEBUG cinder.db.api [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Building query based on filter {{(pid=86708) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.image.image_utils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86708) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 09:42:32 devstack cinder-volume[86708]: INFO cinder.keymgr.migration [None req-dc96ff33-1bcb-4a36-9c2f-199bd9df8e07 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=86708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=86708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:32 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:42:32 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:32 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.228s {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.manager [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Notifying Schedulers of capabilities ... {{(pid=86708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:42:32 devstack cinder-volume[86708]: INFO cinder.volume.manager [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Driver initialization completed successfully. Sep 07 09:42:32 devstack cinder-volume[86708]: INFO cinder.manager [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Initiating service 3 cleanup Sep 07 09:42:32 devstack cinder-volume[86708]: INFO cinder.manager [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Service 3 cleanup completed. Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.service [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Creating RPC server for service cinder-volume {{(pid=86708) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.service [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86708) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 09:42:32 devstack cinder-volume[86708]: INFO cinder.volume.manager [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=86708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=86708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:32 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:42:32 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:32 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:32 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.271s {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:32 devstack cinder-volume[86708]: INFO cinder.volume.manager [None req-ce43718c-2960-4ac8-bc2e-24d69188583f None None] Driver post RPC initialization completed successfully. Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=86708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG cinder.volume.drivers.quobyte [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=86708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:37 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:42:37 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:37 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG oslo_concurrency.processutils [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.248s {{(pid=86708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:37 devstack cinder-volume[86708]: DEBUG cinder.manager [None req-511cdac6-5e5e-4d38-8a1a-8a65a11ae074 None None] Notifying Schedulers of capabilities ... {{(pid=86708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:42:38 devstack cinder-volume[86492]: INFO oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Caught SIGTERM, stopping children Sep 07 09:42:38 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Acquiring lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:42:38 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Acquired lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:42:38 devstack cinder-volume[86492]: DEBUG oslo_concurrency.lockutils [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Releasing lock "singleton_lock" {{(pid=86492) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:42:38 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Stop services. {{(pid=86492) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 09:42:38 devstack cinder-volume[86492]: DEBUG oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Killing children. {{(pid=86492) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 09:42:38 devstack cinder-volume[86492]: INFO oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Waiting on 1 children to exit Sep 07 09:42:40 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Acquiring lock "singleton_lock" {{(pid=86708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:42:40 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Acquired lock "singleton_lock" {{(pid=86708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:42:40 devstack cinder-volume[86708]: DEBUG oslo_concurrency.lockutils [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Releasing lock "singleton_lock" {{(pid=86708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:42:40 devstack cinder-volume[86708]: WARNING amqp [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:42:40 devstack cinder-volume[86708]: WARNING amqp [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:42:40 devstack cinder-volume[86492]: INFO oslo_service.backend._eventlet.service [None req-db21d637-1ea8-4370-a207-b65189ba4d56 None None] Child 86708 exited with status 0 Sep 07 09:42:41 devstack cinder-volume[86992]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 09:42:41 devstack cinder-volume[86992]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:42:41 devstack cinder-volume[86992]: we strongly recommend against using it for new projects. Sep 07 09:42:41 devstack cinder-volume[86992]: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:42:41 devstack cinder-volume[86992]: framework. For more detail see Sep 07 09:42:41 devstack cinder-volume[86992]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:42:41 devstack cinder-volume[86992]: import eventlet # noqa Sep 07 09:42:44 devstack cinder-volume[86992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:42:44 devstack cinder-volume[86992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:42:44 devstack cinder-volume[86992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86992) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:42:45 devstack cinder-volume[86992]: INFO dbcounter [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Registered counter for database cinder Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_db.sqlalchemy.engines [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG dbcounter [-] [86992] Writer thread running {{(pid=86992) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:42:45 devstack cinder-volume[86992]: INFO cinder.rpc [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 09:42:45 devstack cinder-volume[86992]: INFO cinder.rpc [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_db.sqlalchemy.engines [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:45 devstack cinder-volume[86992]: INFO cinder.volume.manager [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Determined volume DB was empty at startup. Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG cinder.volume.manager [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86992) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 09:42:45 devstack cinder-volume[86992]: WARNING stevedore.named [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:42:45 devstack cinder-volume[86992]: WARNING castellan.key_manager [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:42:45 devstack cinder-volume[86992]: WARNING cinder.keymgr.conf_key_mgr [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:42:45 devstack cinder-volume[86992]: INFO cinder.volume.manager [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_db.sqlalchemy.engines [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:45 devstack cinder-volume[86992]: INFO oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Starting 1 workers Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Started child 87290 {{(pid=86992) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Full set of CONF: {{(pid=86992) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] ******************************************************************************** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] Configuration options gathered from: {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] ================================================================================ {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] allow_availability_zone_fallback = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] allow_compression_on_image_upload = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] allowed_direct_url_schemes = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] api_rate_limit = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] auth_strategy = keystone {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_availability_zone = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_host = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_stats_polling_interval = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backup_api_class = cinder.backup.api.API {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[87290]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backup_name_template = backup-%s {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backup_use_same_host = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backup_use_temp_snapshot = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] chap_password = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] chap_username = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_internal_tenant_project_id = 20578c589c9f4d689e92014258cd88d0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_internal_tenant_user_id = 72d4aa63cab4497b9acfc601c2c226f9 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cluster = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] compression_format = gzip {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] compute_api_class = cinder.compute.nova.API {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] config_dir = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] config_source = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] control_exchange = openstack {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] debug = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] default_availability_zone = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] default_group_type = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] default_volume_type = QuobyteHD {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] disk_geometry = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] driver_client_cert = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] driver_client_cert_key = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] driver_data_namespace = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] driver_ssl_cert_path = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] driver_ssl_cert_verify = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] driver_use_ssl = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] enable_new_services = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] enable_unsupported_driver = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] enabled_backends = ['QuobyteHD'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] enforce_multipath_for_image_xfer = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] filter_function = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_api_insecure = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_api_ssl_compression = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_ca_certificates_file = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_catalog_info = image:glance:publicURL {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_num_retries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance_request_timeout = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] goodness_function = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] graceful_shutdown_timeout = 5 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] group_api_class = cinder.group.api.API {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] host = devstack {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_compress_on_upload = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_conversion_address_space_limit = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_conversion_cpu_limit = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_conversion_disable = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_upload_use_cinder_backend = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_upload_use_internal_tenant = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_volume_cache_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_volume_cache_max_count = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] image_volume_cache_max_size_gb = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] init_host_max_objects_retrieval = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] instance_format = [instance: %(uuid)s] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] iscsi_target_flags = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] iscsi_write_cache = on {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] iser_helper = tgtadm {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] iser_ip_address = 192.168.122.65 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] iser_port = 3260 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_color = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_config_append = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_dir = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_file = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_options = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_rotate_interval = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_rotate_interval_type = days {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] log_rotation_type = none {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] max_age = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] max_logfile_count = 30 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] max_logfile_size_mb = 200 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] max_over_subscription_ratio = 20.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] message_reap_interval = 86400 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] message_ttl = 2592000 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] migration_create_volume_timeout_secs = 300 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] monkey_patch = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] monkey_patch_modules = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] my_ip = 192.168.122.65 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] no_snapshot_gb_quota = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] num_iser_scan_tries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] num_shell_tries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] num_volume_device_scan_tries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] nvmeof_conn_info_version = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] nvmet_ns_id = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] nvmet_port_id = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] osapi_max_limit = 1000 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] osapi_volume_ext_list = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] osapi_volume_listen_port = 8776 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] osapi_volume_use_ssl = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] osapi_volume_workers = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] per_volume_size_limit = -1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] periodic_fuzzy_delay = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] periodic_interval = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] public_endpoint = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] publish_errors = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] quota_backup_gigabytes = 1000 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] quota_backups = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87290) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] quota_gigabytes = 1000 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] quota_groups = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] quota_snapshots = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] quota_volumes = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] rate_limit_burst = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] rate_limit_except_level = CRITICAL {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] rate_limit_interval = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] reinit_driver_count = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] replication_device = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] report_discard_supported = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] report_interval = 120 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] reservation_clean_interval = 86400 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] reservation_expire = 86400 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] reserved_image_namespaces = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] reserved_percentage = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] rpc_response_timeout = 120 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] run_external_periodic_tasks = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] scst_target_driver = iscsi {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] scst_target_iqn_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_down_time = 720 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] shell_completion = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] snapshot_name_template = snapshot-%s {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] split_loggers = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] state_path = /opt/stack/data/cinder {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] storage_availability_zone = nova {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] storage_protocol = iSCSI {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] syslog_log_facility = LOG_USER {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] target_helper = lioadm {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] target_ip_address = 192.168.122.65 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] target_port = 3260 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] target_protocol = iscsi {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] target_secondary_ip_addresses = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] trace_flags = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:45 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] transport_url = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] until_refresh = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] use_chap_auth = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] use_default_quota_class = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] use_journal = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] use_json = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] use_multipath_for_image_xfer = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] use_stderr = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] use_syslog = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] verify_glance_signatures = enabled {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_api_class = cinder.volume.api.API {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_backend_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_clear = zero {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_clear_ionice = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_clear_size = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_copy_bps_limit = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_dd_blocksize = 1M {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_name_template = volume-%s {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_service_inithost_offload = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volume_usage_audit_period = month {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] zoning_mode = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_concurrency.disable_process_locking = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.auth_section = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.auth_type = password {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.auth_version = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.cache = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.include_service_catalog = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.insecure = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.interface = public {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_password = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcache_username = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.region_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.service_type = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.backend = dogpile.cache.null {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.backend_argument = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.backend_expiration_time = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.config_prefix = cache.oslo {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.debug_cache_backend = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.enable_retry_client = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.enable_socket_keepalive = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.expiration_time = 600 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.hashclient_retry_attempts = 2 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.memcache_dead_retry = 300 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.memcache_pool_maxsize = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.memcache_sasl_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.password = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.proxies = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.redis_db = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.redis_server = localhost:6379 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.retry_attempts = 2 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.retry_delay = 0.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.socket_keepalive_count = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.socket_keepalive_idle = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.socket_keepalive_interval = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.socket_timeout = 1.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.tls_allowed_ciphers = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.tls_cafile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.tls_certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.tls_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87290) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.tls_keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cache.username = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] coordination.backend_url = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.asyncio_connection = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.asyncio_slave_connection = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.backend = sqlalchemy {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.connection = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.connection_debug = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.connection_parameters = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.connection_recycle_time = 3600 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.connection_trace = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.db_inc_retry_interval = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.db_max_retries = 20 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.db_max_retry_interval = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.db_retry_interval = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.max_overflow = 50 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.max_pool_size = 5 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.max_retries = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.mysql_wsrep_sync_wait = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.pool_timeout = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.retry_interval = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.slave_connection = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.sqlite_synchronous = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.synchronous_reader = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] database.use_db_reconnect = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_tracing.insecure = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.connection_string = messaging:// {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.es_doc_type = notification {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.es_scroll_size = 10000 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.es_scroll_time = 2m {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.filter_error_trace = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.hmac_keys = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.sentinel_service_name = mymaster {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.socket_timeout = 0.1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.trace_requests = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler.trace_sqlalchemy = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler_jaeger.process_tags = {} {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler_jaeger.service_name_prefix = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] profiler_otlp.service_name_prefix = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.enforce_new_defaults = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.policy_default_rule = default {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.policy_file = policy.yaml {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] privsep_osbrick.group = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] privsep_osbrick.helper_command = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] privsep_osbrick.user = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_sys_admin.group = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_sys_admin.helper_command = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] cinder_sys_admin.user = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.auth_section = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.auth_type = password {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.cafile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.collect_timing = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.insecure = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.send_service_user_token = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.split_loggers = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.timeout = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.tls_ciphers = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] service_user.tls_min_version = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.auth_section = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.auth_type = password {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.collect_timing = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.insecure = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.region_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.split_loggers = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.timeout = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.tls_ciphers = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] glance.tls_min_version = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.backend_availability_zone = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.chap_password = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.chap_username = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.disk_geometry = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.driver_client_cert = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.driver_client_cert_key = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.driver_data_namespace = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.driver_use_ssl = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.extra_capabilities = {} {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] CMD "mount.quobyte" returned: 1 in 0.046s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.filter_function = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.goodness_function = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.iscsi_target_flags = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.iscsi_write_cache = on {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.iser_helper = tgtadm {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.iser_port = 3260 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_host = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_login = admin {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_mount_options = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_password = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_private_key = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_share_path = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.num_shell_tries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.quobyte_volume_url = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.replication_device = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.report_discard_supported = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.reserved_percentage = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.target_helper = tgtadm {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.target_port = 3260 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.target_protocol = iscsi {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.trace_flags = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.unique_fqdn_network = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.use_chap_auth = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_backend_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_clear = zero {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_clear_ionice = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_clear_size = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_reports.file_event_handler = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_reports.log_dir = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.backend_availability_zone = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.backend_host = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.chap_password = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.chap_username = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.chiscsi_conf = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.disk_geometry = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.driver_client_cert = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.driver_data_namespace = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.driver_use_ssl = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.extra_capabilities = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.filter_function = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.goodness_function = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.iser_helper = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.iser_ip_address = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.iser_port = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.iser_target_prefix = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_host = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_login = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_mount_options = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_password = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_private_key = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_share_path = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_ssh_port = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.num_shell_tries = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.nvmet_port_id = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.replication_device = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.report_discard_supported = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.reserved_percentage = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.scst_target_driver = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.storage_protocol = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.target_helper = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.target_ip_address = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.target_port = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.target_prefix = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.target_protocol = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.trace_flags = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.use_chap_auth = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_clear = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_clear_size = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] QuobyteHD.volumes_dir = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.ssl = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_notifications.driver = [] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_notifications.retry = -1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] key_manager.fixed_key = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.barbican_api_version = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.barbican_endpoint = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.barbican_endpoint_type = public {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.barbican_region_name = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.cafile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.collect_timing = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.insecure = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.number_of_retries = 60 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.retry_delay = 1 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.send_service_user_token = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.split_loggers = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.timeout = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.tls_ciphers = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.tls_min_version = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.verify_ssl = True {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican.verify_ssl_path = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.auth_section = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.auth_type = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.cafile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.certfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.collect_timing = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.insecure = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.keyfile = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.split_loggers = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.timeout = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.tls_ciphers = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] barbican_service_user.tls_min_version = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.approle_role_id = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.approle_secret_id = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.auth_method = approle {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.auth_path = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.kv_mountpoint = secret {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.kv_path = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.kv_version = 2 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.namespace = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.root_token_id = **** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.ssl_ca_crt_file = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.timeout = 60.0 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.token_file = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.token_role = None {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.use_ssl = False {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:42:46 devstack cinder-volume[86992]: DEBUG oslo_service.backend._eventlet.service [None req-136aa39a-be9d-4766-b4ce-b1a8fec67239 None None] ******************************************************************************** {{(pid=86992) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 09:42:46 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.244s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:46 devstack cinder-volume[87290]: INFO cinder.volume.driver [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.driver [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6140975952148, 'free_capacity_gb': 1773.6140975952148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87290) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_db.sqlalchemy.engines [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writer thread running {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.db.api [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Building query based on filter {{(pid=87290) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87290) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:46 devstack cinder-volume[87290]: INFO cinder.keymgr.migration [None req-f6857a16-25bf-44d1-bff6-7f74e0ced8dd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 09:42:46 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:42:46 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:46 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.235s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:42:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Driver initialization completed successfully. Sep 07 09:42:46 devstack cinder-volume[87290]: INFO cinder.manager [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Initiating service 3 cleanup Sep 07 09:42:46 devstack cinder-volume[87290]: INFO cinder.manager [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Service 3 cleanup completed. Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.service [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Creating RPC server for service cinder-volume {{(pid=87290) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.service [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87290) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 09:42:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:42:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:42:46 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:42:46 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:42:47 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Sep 07 09:42:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.228s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:42:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6cac19f2-5955-4a62-a35e-e970882488a5 None None] Driver post RPC initialization completed successfully. Sep 07 09:42:55 devstack cinder-volume[86992]: DEBUG dbcounter [-] [86992] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86992) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:42:56 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:42:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:43:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:43:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 6 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:43:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:43:45 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Flow 'volume_create_manager' (402a6142-6fea-4116-a106-9b7cbf9d2d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f25bae-fb0e-420d-8bbe-b2c6a830bd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f25bae-fb0e-420d-8bbe-b2c6a830bd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-814082563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1474fa80b84f7aa3b94c9a4aa410d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:43:46Z,use_quota=True,user_id='a26aeb88500349299c6d23d8c4dd23af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be92d942-104d-4786-a72f-ec7646e9e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be92d942-104d-4786-a72f-ec7646e9e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e722f59-928f-4346-addb-2e5437085637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e722f59-928f-4346-addb-2e5437085637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6', 'volume_name': 'volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd710f4f-8922-49bd-aa06-92d9f8f9ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd710f4f-8922-49bd-aa06-92d9f8f9ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22307bcb-3e51-430e-927e-10e685465886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:43:46 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Volume cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6', 'volume_size': 1} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-814082563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1474fa80b84f7aa3b94c9a4aa410d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:43:46Z,use_quota=True,user_id='a26aeb88500349299c6d23d8c4dd23af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Creating volume cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:43:46 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:43:46 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 1073741824 Sep 07 09:43:46 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:43:46 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 1073741824" returned: 0 in 0.651s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:43:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:43:46 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 Sep 07 09:43:46 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:43:47 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Sep 07 09:43:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:43:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:43:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:43:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22307bcb-3e51-430e-927e-10e685465886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:43:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cfb616-8c16-462f-ba6c-28b58bfb90c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:43:47 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Volume volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 (cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6): created successfully Sep 07 09:43:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cfb616-8c16-462f-ba6c-28b58bfb90c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:43:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Flow 'volume_create_manager' (402a6142-6fea-4116-a106-9b7cbf9d2d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:43:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fb323fee-74bb-4c25-9883-cc1c9714c6d9 tempest-TaggedAttachmentsTest-650481390 None] Created volume successfully. Sep 07 09:43:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=1,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:43:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Flow 'volume_create_manager' (9fc7efe5-33eb-47f2-abe1-972e3c1d7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f208b1-acda-4766-be23-3d13328e5581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f208b1-acda-4766-be23-3d13328e5581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-227326524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdc34b4-75fa-4114-9209-31a709175334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f952787de74407db91ce01fe6762035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:12Z,use_quota=True,user_id='cb6b581b51d8443bbd12ae09cf6bb943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77f6e53-9334-49de-b3c5-fcddbc4eba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77f6e53-9334-49de-b3c5-fcddbc4eba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a28cbb2-1f33-49e4-8f93-10ec71c8d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a28cbb2-1f33-49e4-8f93-10ec71c8d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdc34b4-75fa-4114-9209-31a709175334', 'volume_name': 'volume-9fdc34b4-75fa-4114-9209-31a709175334', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6113af8f-4a25-4ad3-b31c-78fae58f26ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6113af8f-4a25-4ad3-b31c-78fae58f26ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74a3080-fe30-49c4-8963-fafa280efd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Volume 9fdc34b4-75fa-4114-9209-31a709175334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdc34b4-75fa-4114-9209-31a709175334', 'volume_size': 1} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-227326524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdc34b4-75fa-4114-9209-31a709175334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f952787de74407db91ce01fe6762035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:12Z,use_quota=True,user_id='cb6b581b51d8443bbd12ae09cf6bb943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Creating volume 9fdc34b4-75fa-4114-9209-31a709175334 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:44:12 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:44:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:12 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 1073741824 Sep 07 09:44:12 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:13 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 1073741824" returned: 0 in 1.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:13 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 Sep 07 09:44:13 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:14 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334" returned: 0 in 0.434s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:44:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74a3080-fe30-49c4-8963-fafa280efd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdc34b4-75fa-4114-9209-31a709175334', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a20ebb-77b1-4b3c-b546-bf9a89ab03c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:14 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Volume volume-9fdc34b4-75fa-4114-9209-31a709175334 (9fdc34b4-75fa-4114-9209-31a709175334): created successfully Sep 07 09:44:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a20ebb-77b1-4b3c-b546-bf9a89ab03c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Flow 'volume_create_manager' (9fc7efe5-33eb-47f2-abe1-972e3c1d7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ae972713-cbea-4ca1-9b94-7855ba0e50f8 tempest-VolumesAdminNegativeTest-635122324 None] Created volume successfully. Sep 07 09:44:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Acquiring lock "cinder-9fdc34b4-75fa-4114-9209-31a709175334-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Lock "cinder-9fdc34b4-75fa-4114-9209-31a709175334-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Acquiring lock "cinder-quobyte-9fdc34b4-75fa-4114-9209-31a709175334" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Lock "cinder-quobyte-9fdc34b4-75fa-4114-9209-31a709175334" acquired by "delete_volume" :: waited 0.046s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:17 devstack cinder-volume[87290]: INFO oslo.privsep.daemon [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpklkm3otu/privsep.sock'] Sep 07 09:44:17 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpklkm3otu/privsep.sock Sep 07 09:44:17 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 09:44:19 devstack cinder-volume[87290]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 09:44:20 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:20 devstack cinder-volume[87290]: INFO oslo.privsep.daemon [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Spawned new privsep daemon via rootwrap Sep 07 09:44:20 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Accepted privsep connection to /tmp/tmpklkm3otu/privsep.sock {{(pid=87290) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 09:44:20 devstack cinder-volume[87290]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 09:44:20 devstack cinder-volume[87290]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 09:44:20 devstack cinder-volume[87290]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 09:44:20 devstack cinder-volume[87290]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88436 Sep 07 09:44:20 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c5a27-e5ba-4924-98e0-85c420da53d8]: (2,) {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:44:20 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2859cef-177a-4044-8ec9-c99c6367c35d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:44:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:21 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 Sep 07 09:44:21 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:21 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334" returned: 0 in 0.848s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:21 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334 Sep 07 09:44:21 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:22 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9fdc34b4-75fa-4114-9209-31a709175334" returned: 0 in 0.573s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Lock "cinder-quobyte-9fdc34b4-75fa-4114-9209-31a709175334" released by "delete_volume" :: held 4.698s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:22 devstack cinder-volume[87290]: WARNING cinder.quota [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:44:22 devstack cinder-volume[87290]: WARNING cinder.quota [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Created reservations ['a3c121a0-af03-4832-92c7-10cd49f354ed', 'a108d4df-102c-4c88-943d-79a1944bed64', 'c946ea6d-96b4-4d60-acfa-e4c5d538b24e', 'da0c8d8c-9a76-46c1-9f1a-0b32f36a7e5c'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:22 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:44:22 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:23 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.398s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:23 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:44:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Deleted volume successfully. Sep 07 09:44:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c69c754c-b96d-43e0-acd2-c6e8d8f780f9 tempest-VolumesAdminNegativeTest-635122324 None] Lock "cinder-9fdc34b4-75fa-4114-9209-31a709175334-delete_volume" released by "delete_volume" :: held 5.668s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Flow 'volume_create_manager' (a45ae109-b125-47be-9784-9465d4b39083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3451448-c5c9-4f38-b2ea-16e1460a07e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3451448-c5c9-4f38-b2ea-16e1460a07e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-226926320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312d9f5b-3de3-491c-8392-53880a644261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c09b4b1c84aa4f5ca2b6eed8f0989963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:25Z,use_quota=True,user_id='8e436c489d18438cad6936ed4d5c6c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1396e4fe-5f85-4cef-8da1-25170471c448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1396e4fe-5f85-4cef-8da1-25170471c448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72886a04-9d91-40ec-8725-e0414fc9847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72886a04-9d91-40ec-8725-e0414fc9847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312d9f5b-3de3-491c-8392-53880a644261', 'volume_name': 'volume-312d9f5b-3de3-491c-8392-53880a644261', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4207a1a6-dd87-401d-867b-f3b79344f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4207a1a6-dd87-401d-867b-f3b79344f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71cc2b5-c0cd-40f5-a0aa-2deb1285c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:25 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Volume 312d9f5b-3de3-491c-8392-53880a644261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312d9f5b-3de3-491c-8392-53880a644261', 'volume_size': 1} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-226926320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312d9f5b-3de3-491c-8392-53880a644261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c09b4b1c84aa4f5ca2b6eed8f0989963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:25Z,use_quota=True,user_id='8e436c489d18438cad6936ed4d5c6c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Creating volume 312d9f5b-3de3-491c-8392-53880a644261 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:44:25 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:25 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 1073741824 Sep 07 09:44:25 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:25 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 1073741824" returned: 0 in 0.708s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:26 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 Sep 07 09:44:26 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:26 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261" returned: 0 in 0.452s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71cc2b5-c0cd-40f5-a0aa-2deb1285c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312d9f5b-3de3-491c-8392-53880a644261', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc9f0d1-dafc-4060-ae9c-4ce4f33ccde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:26 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Volume volume-312d9f5b-3de3-491c-8392-53880a644261 (312d9f5b-3de3-491c-8392-53880a644261): created successfully Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc9f0d1-dafc-4060-ae9c-4ce4f33ccde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Flow 'volume_create_manager' (a45ae109-b125-47be-9784-9465d4b39083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-a9ecc933-a3bc-49d1-9892-e5ef1b2b9c32 req-744214cc-7834-4f65-ba80-f6f982cc62d1 tempest-VolumesGetTestJSON-423514566 None] Created volume successfully. Sep 07 09:44:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Acquiring lock "cinder-312d9f5b-3de3-491c-8392-53880a644261-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Lock "cinder-312d9f5b-3de3-491c-8392-53880a644261-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Acquiring lock "cinder-quobyte-312d9f5b-3de3-491c-8392-53880a644261" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Lock "cinder-quobyte-312d9f5b-3de3-491c-8392-53880a644261" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b39f123-36fb-4551-a320-c219920c3553]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:44:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:28 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 Sep 07 09:44:28 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:28 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261" returned: 0 in 0.521s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:28 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261 Sep 07 09:44:28 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:28 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-312d9f5b-3de3-491c-8392-53880a644261" returned: 0 in 0.322s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Lock "cinder-quobyte-312d9f5b-3de3-491c-8392-53880a644261" released by "delete_volume" :: held 0.916s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG cinder.quota [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Created reservations ['be026bbc-313b-4d0f-bf1b-9e0c7bd4950c', '978332e8-ed17-4fc1-b77b-19268d9b5d62', '54bd66d4-b775-4382-9671-3fedbd79dfbc', 'a7f7253f-44d2-4886-ba01-f85406737f57'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:28 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:44:28 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:29 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.337s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:29 devstack cinder-volume[87290]: DEBUG cinder.manager [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:44:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Deleted volume successfully. Sep 07 09:44:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-769d75a3-e785-44b8-81f1-996cf2d517f4 req-b9b9082c-2717-4c72-800f-922a363a2995 tempest-VolumesGetTestJSON-423514566 None] Lock "cinder-312d9f5b-3de3-491c-8392-53880a644261-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Flow 'volume_create_manager' (2d758a99-a9ea-4cbe-a308-0f38e5e7e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a7f207-9dc7-42f2-8449-2b3026dce7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a7f207-9dc7-42f2-8449-2b3026dce7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1942923369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca903ef4-9df5-4f5a-bbac-9e7fc3db485c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f255406094c0198d1bf19499f33aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:34Z,use_quota=True,user_id='d89bbc33dbc34dab92d241bfa4286585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78cb5f9-bc76-4aa1-a9ae-ebbb7cd56d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78cb5f9-bc76-4aa1-a9ae-ebbb7cd56d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6257f5-10fe-49a1-8a9a-b0a7e3a04eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6257f5-10fe-49a1-8a9a-b0a7e3a04eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca903ef4-9df5-4f5a-bbac-9e7fc3db485c', 'volume_name': 'volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f780c7-f7c1-49d9-9bf8-9a017a5f0859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f780c7-f7c1-49d9-9bf8-9a017a5f0859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84df57f4-0a44-4e1a-a0bc-918cbde825f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:34 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Volume ca903ef4-9df5-4f5a-bbac-9e7fc3db485c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c', 'volume_size': 1} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1942923369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca903ef4-9df5-4f5a-bbac-9e7fc3db485c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f255406094c0198d1bf19499f33aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:34Z,use_quota=True,user_id='d89bbc33dbc34dab92d241bfa4286585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Creating volume ca903ef4-9df5-4f5a-bbac-9e7fc3db485c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:44:34 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:34 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c 1073741824 Sep 07 09:44:34 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:34 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c 1073741824" returned: 0 in 0.514s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:34 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c Sep 07 09:44:34 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:34 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84df57f4-0a44-4e1a-a0bc-918cbde825f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d1909b-b88a-4a0f-bcfc-c34bd506770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:34 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Volume volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c (ca903ef4-9df5-4f5a-bbac-9e7fc3db485c): created successfully Sep 07 09:44:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d1909b-b88a-4a0f-bcfc-c34bd506770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Flow 'volume_create_manager' (2d758a99-a9ea-4cbe-a308-0f38e5e7e014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e9ce6026-12b0-4b08-b761-b343449c1e6c tempest-VolumesTestJSON-1925708255 None] Created volume successfully. Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Flow 'volume_create_manager' (114a846b-e161-41d6-a19f-79a3613b6045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125a3f63-c9cc-42ff-a545-31ba174f16ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125a3f63-c9cc-42ff-a545-31ba174f16ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1412504714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9f4d59-519b-44d5-bd69-960b9f9a7701,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f255406094c0198d1bf19499f33aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:37Z,use_quota=True,user_id='d89bbc33dbc34dab92d241bfa4286585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af5594a-9017-4469-953f-b37b2410277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af5594a-9017-4469-953f-b37b2410277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c307f5-6a3c-4df2-885d-b200ffc065a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c307f5-6a3c-4df2-885d-b200ffc065a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9f4d59-519b-44d5-bd69-960b9f9a7701', 'volume_name': 'volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e8bc92-a7e4-4755-b395-620dbe8097d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e8bc92-a7e4-4755-b395-620dbe8097d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219a7042-d8c2-40ea-8e6a-c00f3eabddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Volume 9c9f4d59-519b-44d5-bd69-960b9f9a7701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701', 'volume_size': 1} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1412504714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9f4d59-519b-44d5-bd69-960b9f9a7701,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f255406094c0198d1bf19499f33aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:37Z,use_quota=True,user_id='d89bbc33dbc34dab92d241bfa4286585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Creating volume 9c9f4d59-519b-44d5-bd69-960b9f9a7701 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:44:36 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:44:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:36 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 1073741824 Sep 07 09:44:36 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:37 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 1073741824" returned: 0 in 0.461s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:37 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 Sep 07 09:44:37 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:37 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701" returned: 0 in 0.310s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219a7042-d8c2-40ea-8e6a-c00f3eabddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c49a0c-9551-4537-b172-b20b29592c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:37 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Volume volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 (9c9f4d59-519b-44d5-bd69-960b9f9a7701): created successfully Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c49a0c-9551-4537-b172-b20b29592c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Flow 'volume_create_manager' (114a846b-e161-41d6-a19f-79a3613b6045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-280f3c6c-4923-4321-98dc-6269b3310ff8 tempest-VolumesTestJSON-1925708255 None] Created volume successfully. Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Flow 'volume_create_manager' (5c65ff01-0f95-4404-acf8-16214b46f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357d3307-ed47-46ba-9040-fbdcb5917f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357d3307-ed47-46ba-9040-fbdcb5917f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1042435401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d156b9e1-2e96-468a-910b-3c86ea560363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f255406094c0198d1bf19499f33aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:39Z,use_quota=True,user_id='d89bbc33dbc34dab92d241bfa4286585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f313f466-4d7e-4242-9590-0dc72797cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f313f466-4d7e-4242-9590-0dc72797cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f173dd1-a8ac-42c6-beee-f40b4caa6b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f173dd1-a8ac-42c6-beee-f40b4caa6b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd156b9e1-2e96-468a-910b-3c86ea560363', 'volume_name': 'volume-d156b9e1-2e96-468a-910b-3c86ea560363', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e0f1d-dbdf-4a41-a49a-4b2a80e32da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e0f1d-dbdf-4a41-a49a-4b2a80e32da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740be141-9a0b-43d5-bf64-c4b8763f1d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Volume d156b9e1-2e96-468a-910b-3c86ea560363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d156b9e1-2e96-468a-910b-3c86ea560363', 'volume_size': 1} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1042435401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d156b9e1-2e96-468a-910b-3c86ea560363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f255406094c0198d1bf19499f33aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:39Z,use_quota=True,user_id='d89bbc33dbc34dab92d241bfa4286585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Creating volume d156b9e1-2e96-468a-910b-3c86ea560363 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:44:39 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:39 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 1073741824 Sep 07 09:44:39 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:39 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 1073741824" returned: 0 in 0.442s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:39 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 Sep 07 09:44:40 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:40 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363" returned: 0 in 0.326s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740be141-9a0b-43d5-bf64-c4b8763f1d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d156b9e1-2e96-468a-910b-3c86ea560363', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287b81d3-31c7-41d2-b068-cfafa8121da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Volume volume-d156b9e1-2e96-468a-910b-3c86ea560363 (d156b9e1-2e96-468a-910b-3c86ea560363): created successfully Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287b81d3-31c7-41d2-b068-cfafa8121da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Flow 'volume_create_manager' (5c65ff01-0f95-4404-acf8-16214b46f14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ca189dec-83fb-4425-8606-7eb1653d233d tempest-VolumesTestJSON-1925708255 None] Created volume successfully. Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Flow 'volume_create_manager' (86eb0a03-2098-42b8-856b-c02b4139b44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdccf3b4-6772-4c9a-b5aa-30b445cefed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdccf3b4-6772-4c9a-b5aa-30b445cefed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-229960714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fe2e5a-8f31-4003-b995-701371dec377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddaf88201314b20b59c79628ff208b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:41Z,use_quota=True,user_id='f713f4b61fb74306a55e670d44a06d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6faa33-9de2-4370-a281-f1ef957ae6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6faa33-9de2-4370-a281-f1ef957ae6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ccd760-19e7-4db0-af60-17b929a23aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ccd760-19e7-4db0-af60-17b929a23aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28fe2e5a-8f31-4003-b995-701371dec377', 'volume_name': 'volume-28fe2e5a-8f31-4003-b995-701371dec377', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1d0443-9160-437f-b34d-2588745ce04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1d0443-9160-437f-b34d-2588745ce04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db687af-4719-453a-becd-bfbe8dae99ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Volume 28fe2e5a-8f31-4003-b995-701371dec377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28fe2e5a-8f31-4003-b995-701371dec377', 'volume_size': 1} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-229960714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fe2e5a-8f31-4003-b995-701371dec377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddaf88201314b20b59c79628ff208b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:44:41Z,use_quota=True,user_id='f713f4b61fb74306a55e670d44a06d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Creating volume 28fe2e5a-8f31-4003-b995-701371dec377 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:44:40 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:44:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:40 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 1073741824 Sep 07 09:44:40 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:41 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:44:41 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:41 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.276s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 8 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:44:41 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 1073741824" returned: 0 in 0.568s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:41 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 Sep 07 09:44:41 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:41 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377" returned: 0 in 0.332s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db687af-4719-453a-becd-bfbe8dae99ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fe2e5a-8f31-4003-b995-701371dec377', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6dc2d5-c03f-49fd-9e30-a2fcf186e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:44:41 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Volume volume-28fe2e5a-8f31-4003-b995-701371dec377 (28fe2e5a-8f31-4003-b995-701371dec377): created successfully Sep 07 09:44:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6dc2d5-c03f-49fd-9e30-a2fcf186e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:44:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Flow 'volume_create_manager' (86eb0a03-2098-42b8-856b-c02b4139b44f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:44:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e0a4e1e4-947f-4b6b-b4fe-af26cacac6d7 tempest-AttachVolumeTestJSON-728167824 None] Created volume successfully. Sep 07 09:44:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Acquiring lock "cinder-d156b9e1-2e96-468a-910b-3c86ea560363-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Lock "cinder-d156b9e1-2e96-468a-910b-3c86ea560363-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Acquiring lock "cinder-quobyte-d156b9e1-2e96-468a-910b-3c86ea560363" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Lock "cinder-quobyte-d156b9e1-2e96-468a-910b-3c86ea560363" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eb793c-3782-47c6-b76a-9d6ab4d4c560]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:44:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:42 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 Sep 07 09:44:42 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:43 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363" returned: 0 in 0.532s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:43 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363 Sep 07 09:44:43 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:43 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d156b9e1-2e96-468a-910b-3c86ea560363" returned: 0 in 0.335s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Lock "cinder-quobyte-d156b9e1-2e96-468a-910b-3c86ea560363" released by "delete_volume" :: held 0.926s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Created reservations ['51fb0d33-86ef-4332-b5ec-54e04528537a', 'b8f589c8-b866-4f10-8e7d-f9e535601fc9', 'acdcd142-e7d5-49b3-89b4-3c705cceb8d8', '0ad5adfb-3115-483a-afbb-8c27b6f2653e'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:43 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:44:43 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Acquiring lock "cinder-9c9f4d59-519b-44d5-bd69-960b9f9a7701-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Lock "cinder-9c9f4d59-519b-44d5-bd69-960b9f9a7701-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Acquiring lock "cinder-quobyte-9c9f4d59-519b-44d5-bd69-960b9f9a7701" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Lock "cinder-quobyte-9c9f4d59-519b-44d5-bd69-960b9f9a7701" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1cc2ce-5eb6-4fc2-b9c4-4ce217edeabe]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:44:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:44 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.323s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:44:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Deleted volume successfully. Sep 07 09:44:44 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 Sep 07 09:44:44 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6a1bcaa0-6c26-482c-a0dd-d936ec1301ea tempest-VolumesTestJSON-1925708255 None] Lock "cinder-d156b9e1-2e96-468a-910b-3c86ea560363-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:44 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701" returned: 0 in 0.469s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:44 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701 Sep 07 09:44:44 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:44 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c9f4d59-519b-44d5-bd69-960b9f9a7701" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Lock "cinder-quobyte-9c9f4d59-519b-44d5-bd69-960b9f9a7701" released by "delete_volume" :: held 0.790s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Created reservations ['13f934de-5507-4277-9b6d-085f8493ce4a', 'e697155e-e3e3-40b0-86e7-fef9953bfeb5', 'e5a39195-18ee-4409-9a89-082a07f42ac0', '00771ca4-bdef-4717-88e8-6dac28a66662'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:44 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:44:44 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Acquiring lock "cinder-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Lock "cinder-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Acquiring lock "cinder-quobyte-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Lock "cinder-quobyte-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d568f8-9db8-4999-bd44-5e053200a1ba]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:45 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.333s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:44:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Deleted volume successfully. Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-76589294-1bda-428f-b5ea-936ca54655d9 tempest-VolumesTestJSON-1925708255 None] Lock "cinder-9c9f4d59-519b-44d5-bd69-960b9f9a7701-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:45 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c Sep 07 09:44:45 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:45 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c" returned: 0 in 0.420s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:45 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c Sep 07 09:44:45 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:45 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c" returned: 0 in 0.275s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Lock "cinder-quobyte-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c" released by "delete_volume" :: held 0.744s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:45 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Created reservations ['bda706b3-9aee-41c0-9383-496c78c62ea9', 'f18b10f4-68dc-4d8e-81da-426cbdcf83e5', 'c9d16525-2363-44f8-b57d-bd23ce4b0321', '882835fe-935c-4cb9-b3fb-47fc2fe37748'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:44:46 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:44:46 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:44:46 devstack cinder-volume[87290]: WARNING py.warnings [req-600171a2-0261-4805-9839-e7ff5f324d42 req-318f4ac7-4456-4f6e-b6ce-542268146e95 tempest-AttachVolumeTestJSON-728167824 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 07 09:44:46 devstack cinder-volume[87290]: .first() Sep 07 09:44:46 devstack cinder-volume[87290]: Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-600171a2-0261-4805-9839-e7ff5f324d42 req-318f4ac7-4456-4f6e-b6ce-542268146e95 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-600171a2-0261-4805-9839-e7ff5f324d42 req-318f4ac7-4456-4f6e-b6ce-542268146e95 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-600171a2-0261-4805-9839-e7ff5f324d42 req-318f4ac7-4456-4f6e-b6ce-542268146e95 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:44:46 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.344s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:44:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Deleted volume successfully. Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-600171a2-0261-4805-9839-e7ff5f324d42 req-318f4ac7-4456-4f6e-b6ce-542268146e95 tempest-AttachVolumeTestJSON-728167824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-28fe2e5a-8f31-4003-b995-701371dec377', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c31867d2-bd3d-484d-822f-fd40ded4827b', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:44:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-85db4c8d-588d-4cfc-99fd-608c5dbd12ba tempest-VolumesTestJSON-1925708255 None] Lock "cinder-ca903ef4-9df5-4f5a-bbac-9e7fc3db485c-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:44:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-600171a2-0261-4805-9839-e7ff5f324d42 req-318f4ac7-4456-4f6e-b6ce-542268146e95 tempest-AttachVolumeTestJSON-728167824 None] attachment_update completed successfully. Sep 07 09:44:56 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=42,cinder:UPDATE=56,cinder:DELETE=8,cinder:INSERT=13 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:44:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=64,cinder:SELECT=46,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:44:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-87321943-9a57-4ae3-a6c3-dd6e504ccdb3 tempest-BackendsCapabilitiesAdminTestsJSON-644036362 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6140975952148, 'free_capacity_gb': 1773.6140975952148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87290) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 09:44:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-290e525d-bd46-434d-915a-53829dc64adf tempest-BackendsCapabilitiesAdminTestsJSON-644036362 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6140975952148, 'free_capacity_gb': 1773.6140975952148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87290) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 09:45:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-165ddfa2-ab0a-4201-9333-773eb5bab938 req-6d2fc5b7-3b08-40f1-9a8d-9be45ac2a5ff tempest-TaggedAttachmentsTest-650481390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-165ddfa2-ab0a-4201-9333-773eb5bab938 req-6d2fc5b7-3b08-40f1-9a8d-9be45ac2a5ff tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-165ddfa2-ab0a-4201-9333-773eb5bab938 req-6d2fc5b7-3b08-40f1-9a8d-9be45ac2a5ff tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-165ddfa2-ab0a-4201-9333-773eb5bab938 req-6d2fc5b7-3b08-40f1-9a8d-9be45ac2a5ff tempest-TaggedAttachmentsTest-650481390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f24a6c48-3a1a-4268-a897-248b002d88e5', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:45:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-165ddfa2-ab0a-4201-9333-773eb5bab938 req-6d2fc5b7-3b08-40f1-9a8d-9be45ac2a5ff tempest-TaggedAttachmentsTest-650481390 None] attachment_update completed successfully. Sep 07 09:45:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-498fd037-9a1b-4547-a949-ac390e4f2dcc tempest-GroupSnapshotsTest-899985263 None] Group tempest-GroupSnapshotsTest-Group-1017567893: creating Sep 07 09:45:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-498fd037-9a1b-4547-a949-ac390e4f2dcc tempest-GroupSnapshotsTest-899985263 None] Group tempest-GroupSnapshotsTest-Group-1017567893: created successfully Sep 07 09:45:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-498fd037-9a1b-4547-a949-ac390e4f2dcc tempest-GroupSnapshotsTest-899985263 None] Create group completed successfully. Sep 07 09:45:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-e06bf668-5a90-4dd0-8ed1-bce96c9c357d req-7ac98c77-937e-4d55-8fad-fb5f06033e52 tempest-TaggedAttachmentsTest-650481390 None] Terminate volume connection completed successfully. Sep 07 09:45:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-e06bf668-5a90-4dd0-8ed1-bce96c9c357d req-7ac98c77-937e-4d55-8fad-fb5f06033e52 tempest-TaggedAttachmentsTest-650481390 None] Deleting attachment f24a6c48-3a1a-4268-a897-248b002d88e5. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (ab4a5850-09cf-4f9d-bb7e-b554055024b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f730185-ba56-4b1c-9d25-2a95fb4d6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f730185-ba56-4b1c-9d25-2a95fb4d6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-356690768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07e672d2-ccab-4a5d-bb5d-bec8308d3d6a,host='devstack@QuobyteHD#QuobyteHD',id=5317b4b3-2905-45a1-abf7-69b202e2c84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:11Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc8b18a4-7009-46a4-9d5b-db2bfc61b403),volume_type_id=dc8b18a4-7009-46a4-9d5b-db2bfc61b403)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76797fde-6e3c-4872-b9c6-6184bb5ad8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76797fde-6e3c-4872-b9c6-6184bb5ad8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e6d431-7079-401d-8507-b2c383ea3c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e6d431-7079-401d-8507-b2c383ea3c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5317b4b3-2905-45a1-abf7-69b202e2c84e', 'volume_name': 'volume-5317b4b3-2905-45a1-abf7-69b202e2c84e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195d9cd3-fcad-4631-8225-bc93775de768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195d9cd3-fcad-4631-8225-bc93775de768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeee92dc-2dc3-43e1-b22d-7dfd12d6655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Volume 5317b4b3-2905-45a1-abf7-69b202e2c84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5317b4b3-2905-45a1-abf7-69b202e2c84e', 'volume_size': 1} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07e672d2-ccab-4a5d-bb5d-bec8308d3d6a,created_at=2026-09-07T07:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-356690768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07e672d2-ccab-4a5d-bb5d-bec8308d3d6a,host='devstack@QuobyteHD#QuobyteHD',id=5317b4b3-2905-45a1-abf7-69b202e2c84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:11Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc8b18a4-7009-46a4-9d5b-db2bfc61b403),volume_type_id=dc8b18a4-7009-46a4-9d5b-db2bfc61b403)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Creating volume 5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:45:10 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:45:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:11 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e 1073741824 Sep 07 09:45:11 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:12 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e 1073741824" returned: 0 in 1.108s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:12 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e Sep 07 09:45:12 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:12 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e" returned: 0 in 0.398s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeee92dc-2dc3-43e1-b22d-7dfd12d6655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5317b4b3-2905-45a1-abf7-69b202e2c84e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99adcafa-c6f0-49ff-830d-9d7b8de60fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Volume volume-5317b4b3-2905-45a1-abf7-69b202e2c84e (5317b4b3-2905-45a1-abf7-69b202e2c84e): created successfully Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99adcafa-c6f0-49ff-830d-9d7b8de60fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (ab4a5850-09cf-4f9d-bb7e-b554055024b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4939a7fe-fdf8-41c1-b295-2917be1307b3 tempest-GroupSnapshotsTest-899985263 None] Created volume successfully. Sep 07 09:45:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] GroupSnapshot c8fe8708-c4e5-43c1-bea9-9d0a66794af0: creating. Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Group snapshot c8fe8708-c4e5-43c1-bea9-9d0a66794af0: creating. {{(pid=87290) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Creating offline snapshot 173848d6-8514-4616-a86e-80ac5828faab of volume 5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[755cf038-b1bb-4f0a-9986-13fe033737c3]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:14 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e Sep 07 09:45:14 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Flow 'volume_create_manager' (04129ee8-9d71-46af-8abe-054f3fb302f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210f5478-cf28-44ba-aac2-4389aef1f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:14 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210f5478-cf28-44ba-aac2-4389aef1f92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-232236606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe1cc11-6d72-425c-9613-2abf4e400f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec820ea178bc4ac1a05cde33444df561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:15Z,use_quota=True,user_id='65698a7e525c476f9a69577be24081ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863b6e7-13d9-44c1-89d7-61144ac89ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863b6e7-13d9-44c1-89d7-61144ac89ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170d91b3-c235-4e1b-952d-233f6812dfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170d91b3-c235-4e1b-952d-233f6812dfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe1cc11-6d72-425c-9613-2abf4e400f52', 'volume_name': 'volume-efe1cc11-6d72-425c-9613-2abf4e400f52', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf49a96-5907-43b3-9bcd-ddbc5c407dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf49a96-5907-43b3-9bcd-ddbc5c407dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7259a8fb-f780-43fb-9d97-a0f9cc1f4441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:14 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Volume efe1cc11-6d72-425c-9613-2abf4e400f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe1cc11-6d72-425c-9613-2abf4e400f52', 'volume_size': 1} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e" returned: 0 in 0.678s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:14 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab 1G Sep 07 09:45:14 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:15 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab 1G" returned: 0 in 0.593s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5317b4b3-2905-45a1-abf7-69b202e2c84e -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:15 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5317b4b3-2905-45a1-abf7-69b202e2c84e -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab Sep 07 09:45:15 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:16 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5317b4b3-2905-45a1-abf7-69b202e2c84e -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab" returned: 0 in 0.539s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:16 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:45:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:16 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab Sep 07 09:45:16 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:16 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab" returned: 0 in 0.518s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:16 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.info Sep 07 09:45:16 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:17 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.info" returned: 0 in 0.400s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:17 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:17 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.info Sep 07 09:45:17 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:17 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.info" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.200s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-232236606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe1cc11-6d72-425c-9613-2abf4e400f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec820ea178bc4ac1a05cde33444df561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:15Z,use_quota=True,user_id='65698a7e525c476f9a69577be24081ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Creating volume efe1cc11-6d72-425c-9613-2abf4e400f52 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:45:17 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:45:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:17 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 1073741824 Sep 07 09:45:17 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fcd2a828-f261-443e-bee2-ee6d835225ea tempest-GroupSnapshotsTest-899985263 None] group_snapshot c8fe8708-c4e5-43c1-bea9-9d0a66794af0: created successfully Sep 07 09:45:18 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 1073741824" returned: 0 in 0.773s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:18 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 Sep 07 09:45:18 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-868e2ae4-e613-47fb-b5ce-a65a884e3d1f req-1f6eccf4-3f1e-482f-aeef-cacf353b8c12 tempest-AttachVolumeTestJSON-728167824 None] Terminate volume connection completed successfully. Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-868e2ae4-e613-47fb-b5ce-a65a884e3d1f req-1f6eccf4-3f1e-482f-aeef-cacf353b8c12 tempest-AttachVolumeTestJSON-728167824 None] Deleting attachment c31867d2-bd3d-484d-822f-fd40ded4827b. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:45:18 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52" returned: 0 in 0.635s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7259a8fb-f780-43fb-9d97-a0f9cc1f4441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe1cc11-6d72-425c-9613-2abf4e400f52', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ec68c3-31d1-4d67-8a31-15066fab086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:18 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Volume volume-efe1cc11-6d72-425c-9613-2abf4e400f52 (efe1cc11-6d72-425c-9613-2abf4e400f52): created successfully Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ec68c3-31d1-4d67-8a31-15066fab086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Flow 'volume_create_manager' (04129ee8-9d71-46af-8abe-054f3fb302f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0586e001-5f98-42d5-8601-ba433b36f457 tempest-DeleteServersTestJSON-1270618337 None] Created volume successfully. Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-173848d6-8514-4616-a86e-80ac5828faab-f2d6a7f5-2914-4591-8f24-4047c442ba67" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-173848d6-8514-4616-a86e-80ac5828faab-f2d6a7f5-2914-4591-8f24-4047c442ba67" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Creating volume f2d6a7f5-2914-4591-8f24-4047c442ba67 from snapshot 173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-f2d6a7f5-2914-4591-8f24-4047c442ba67" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-f2d6a7f5-2914-4591-8f24-4047c442ba67" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] snapshot: 173848d6-8514-4616-a86e-80ac5828faab, volume: f2d6a7f5-2914-4591-8f24-4047c442ba67, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f314850-d2cb-4223-a153-9971b30f7965]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:20 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab Sep 07 09:45:20 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:20 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab" returned: 0 in 0.738s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5317b4b3-2905-45a1-abf7-69b202e2c84e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:45:20 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a33c1c-48fd-45bd-b8d9-f9f36fb162f5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-fd2cd714-b742-4237-8288-fb5cdbe4fe1d req-47c7c39b-569b-4332-a58e-88c278c20c1e tempest-DeleteServersTestJSON-1270618337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:20 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e Sep 07 09:45:20 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:21 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e" returned: 0 in 0.479s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:45:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:45:21 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:45:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:21 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 Sep 07 09:45:21 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Acquiring lock "cinder-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Lock "cinder-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Acquiring lock "cinder-quobyte-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Lock "cinder-quobyte-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6" acquired by "delete_volume" :: waited 0.059s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ac27f8-83a3-4efa-8296-9fc6d5b05e8d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:26 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 Sep 07 09:45:26 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:27 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6" returned: 0 in 1.287s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:27 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6 Sep 07 09:45:27 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:28 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6" returned: 0 in 1.029s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Lock "cinder-quobyte-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6" released by "delete_volume" :: held 2.484s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Created reservations ['f8b2d1d1-15a1-49b6-932a-498ba85c59e3', '33e2d72f-6568-4109-b8c5-66c8d611061b', '25364842-5d82-47a8-b88b-24a68bebd376', 'df57b5bf-0d2c-46f5-a19a-0a809b4a9680'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:28 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:45:28 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:29 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67" returned: 0 in 8.583s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:29 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:45:29 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Converted 1024.00 MB image at 119.28 MB/s Sep 07 09:45:29 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:45:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:29 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 Sep 07 09:45:29 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:29 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.951s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:45:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Deleted volume successfully. Sep 07 09:45:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da9fc37d-8dce-4f26-992a-8a2c8cd5c7ef tempest-TaggedAttachmentsTest-650481390 None] Lock "cinder-cde8eb20-3bf1-4d2c-8817-89b9ffa4d3c6-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:30 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67" returned: 0 in 0.581s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-f2d6a7f5-2914-4591-8f24-4047c442ba67" released by "_copy_volume_from_snapshot" :: held 10.530s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-173848d6-8514-4616-a86e-80ac5828faab-f2d6a7f5-2914-4591-8f24-4047c442ba67" released by "_create_volume_from_snapshot" :: held 10.642s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.664s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-fd2cd714-b742-4237-8288-fb5cdbe4fe1d req-47c7c39b-569b-4332-a58e-88c278c20c1e tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.621s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-fd2cd714-b742-4237-8288-fb5cdbe4fe1d req-47c7c39b-569b-4332-a58e-88c278c20c1e tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-fd2cd714-b742-4237-8288-fb5cdbe4fe1d req-47c7c39b-569b-4332-a58e-88c278c20c1e tempest-DeleteServersTestJSON-1270618337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-efe1cc11-6d72-425c-9613-2abf4e400f52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac67d629-d0a9-4408-9a0e-97d661db4059', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:45:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fb4a7bc0-a02f-46bb-87ba-6ce8e2bb3ea6 tempest-GroupSnapshotsTest-899985263 None] Create group from source-snapshot-c8fe8708-c4e5-43c1-bea9-9d0a66794af0 completed successfully. Sep 07 09:45:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-fd2cd714-b742-4237-8288-fb5cdbe4fe1d req-47c7c39b-569b-4332-a58e-88c278c20c1e tempest-DeleteServersTestJSON-1270618337 None] attachment_update completed successfully. Sep 07 09:45:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-f2d6a7f5-2914-4591-8f24-4047c442ba67" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-f2d6a7f5-2914-4591-8f24-4047c442ba67" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:32 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2efe167-61b3-4f12-a780-06470a695901]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:32 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 Sep 07 09:45:32 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:32 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67" returned: 0 in 0.623s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:32 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67 Sep 07 09:45:32 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:33 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2d6a7f5-2914-4591-8f24-4047c442ba67" returned: 0 in 0.465s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-f2d6a7f5-2914-4591-8f24-4047c442ba67" released by "delete_volume" :: held 1.190s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['aba55af8-a9ad-4e28-a505-c456f049639d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:45:33 devstack cinder-volume[87290]: WARNING cinder.quota [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1907195157 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1907195157, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:45:33 devstack cinder-volume[87290]: WARNING cinder.quota [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1907195157 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1907195157, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['b7f60ad6-8b70-4350-86d2-9bd35a111cd6', '0da2105e-b151-4775-a354-fb478634591e', 'e700ef01-2508-4f6f-a0fb-29addd1429b1', 'eb64ee26-63fe-43e8-a2b2-0184b60aecf2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:33 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:45:33 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:34 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.360s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:34 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:45:34 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c233c10e-becc-407d-ae51-86fe708723f2 tempest-GroupSnapshotsTest-899985263 None] Delete group completed successfully. Sep 07 09:45:34 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] group_snapshot c8fe8708-c4e5-43c1-bea9-9d0a66794af0: deleting Sep 07 09:45:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] group_snapshot c8fe8708-c4e5-43c1-bea9-9d0a66794af0: deleting {{(pid=87290) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 09:45:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-5317b4b3-2905-45a1-abf7-69b202e2c84e" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-5317b4b3-2905-45a1-abf7-69b202e2c84e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-173848d6-8514-4616-a86e-80ac5828faab" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-173848d6-8514-4616-a86e-80ac5828faab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Deleting offline snapshot 173848d6-8514-4616-a86e-80ac5828faab of volume 5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] snapshot_file for this snap is: volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[356af9d4-e179-402c-86a4-62d4c0084d1d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-ed93ff93-2cc0-4fc0-a9b8-3f61a8c18d07 req-54275920-ab46-4d40-a97c-10b0c8d7137d tempest-DeleteServersTestJSON-1270618337 None] Terminate volume connection completed successfully. Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-ed93ff93-2cc0-4fc0-a9b8-3f61a8c18d07 req-54275920-ab46-4d40-a97c-10b0c8d7137d tempest-DeleteServersTestJSON-1270618337 None] Deleting attachment ac67d629-d0a9-4408-9a0e-97d661db4059. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:45:35 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab Sep 07 09:45:35 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:35 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab" returned: 0 in 0.514s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5317b4b3-2905-45a1-abf7-69b202e2c84e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96470b-6485-4447-87ef-826a87a0b28c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:35 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e Sep 07 09:45:35 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:36 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e" returned: 0 in 0.736s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:36 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab Sep 07 09:45:36 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:36 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab" returned: 0 in 0.407s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Acquiring lock "cinder-efe1cc11-6d72-425c-9613-2abf4e400f52-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:36 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab Sep 07 09:45:36 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Lock "cinder-efe1cc11-6d72-425c-9613-2abf4e400f52-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Acquiring lock "cinder-quobyte-efe1cc11-6d72-425c-9613-2abf4e400f52" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Lock "cinder-quobyte-efe1cc11-6d72-425c-9613-2abf4e400f52" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd40014-02c2-4a7a-b554-4a7cb9a686d0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:37 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e.173848d6-8514-4616-a86e-80ac5828faab" returned: 0 in 0.299s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-173848d6-8514-4616-a86e-80ac5828faab" released by "_delete_snapshot" :: held 2.111s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:37 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 Sep 07 09:45:37 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-5317b4b3-2905-45a1-abf7-69b202e2c84e" released by "delete_snapshot" :: held 2.142s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:37 devstack cinder-volume[87290]: WARNING cinder.quota [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1907195157 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1907195157, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['a345a56d-0036-4379-b523-9fc2d9acb371', '479e32c9-397f-4750-827b-776076380175', 'e85d2bf2-b6df-406a-aae4-a3c47619d349', 'e246d3b4-abda-486f-ad1a-c6bb14d98f7d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:45:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6edcb00a-4904-47a4-bf5c-58d8143682c4 tempest-GroupSnapshotsTest-899985263 None] group_snapshot c8fe8708-c4e5-43c1-bea9-9d0a66794af0: deleted successfully Sep 07 09:45:37 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52" returned: 0 in 0.536s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:37 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52 Sep 07 09:45:37 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-5317b4b3-2905-45a1-abf7-69b202e2c84e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-5317b4b3-2905-45a1-abf7-69b202e2c84e" acquired by "delete_volume" :: waited 0.032s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d4605-bc39-43c9-9eba-10c8e17bd5d3]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:37 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-efe1cc11-6d72-425c-9613-2abf4e400f52" returned: 0 in 0.365s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Lock "cinder-quobyte-efe1cc11-6d72-425c-9613-2abf4e400f52" released by "delete_volume" :: held 0.954s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:37 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Created reservations ['7d3075f8-1637-41e9-8a65-0c0239a5331d', 'e6043748-59ff-41bf-a9bc-f917541f080f', '0a917968-3653-49a5-8b4c-6faa98d720e4', 'e9e78946-11d3-467e-b49a-5d48a3aae8b1'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:45:38 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e Sep 07 09:45:38 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:38 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:45:38 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:38 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e" returned: 0 in 0.516s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:38 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e Sep 07 09:45:38 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:38 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.378s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:45:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Deleted volume successfully. Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6beb85bb-55f0-41ba-81ab-5ea7eceabba4 tempest-DeleteServersTestJSON-1270618337 None] Lock "cinder-efe1cc11-6d72-425c-9613-2abf4e400f52-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:38 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5317b4b3-2905-45a1-abf7-69b202e2c84e" returned: 0 in 0.325s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-5317b4b3-2905-45a1-abf7-69b202e2c84e" released by "delete_volume" :: held 0.917s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Created reservations ['07b74ef5-2161-4596-8745-55e76f141f71'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:45:38 devstack cinder-volume[87290]: WARNING cinder.db.api [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1907195157'] Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Created reservations ['31caffa6-64a8-49b3-8067-9ff790a0621c', 'e1c6bc74-714d-4f3e-8ccd-8dbaf884db49', '7f9b07a8-5a0d-486f-a703-77ea55027825', 'fb8eba17-c886-4a98-8cf1-f58081ce2317'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:38 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:45:38 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:39 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.319s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:39 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:45:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2218c27a-d77d-4401-ad49-72daa1d4a3af tempest-GroupSnapshotsTest-899985263 None] Delete group completed successfully. Sep 07 09:45:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0a1ccc38-b229-46e0-9899-f918969547ce tempest-GroupSnapshotsTest-899985263 None] Group tempest-GroupSnapshotsTest-Group-1227985182: creating Sep 07 09:45:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0a1ccc38-b229-46e0-9899-f918969547ce tempest-GroupSnapshotsTest-899985263 None] Group tempest-GroupSnapshotsTest-Group-1227985182: created successfully Sep 07 09:45:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0a1ccc38-b229-46e0-9899-f918969547ce tempest-GroupSnapshotsTest-899985263 None] Create group completed successfully. Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:41 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:45:41 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:41 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.370s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (41b427b2-ce10-4899-b504-17952194b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ab89a2-ffb4-4ddf-bf2e-4e40a6d5c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ab89a2-ffb4-4ddf-bf2e-4e40a6d5c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-16139382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1dfdfa0-c6ba-4928-98ed-6bdd15ff292c,host='devstack@QuobyteHD#QuobyteHD',id=99a0af3b-341a-4022-8fa6-400751483da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:42Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25529f17-d513-41b0-aa07-a324d17a0994),volume_type_id=25529f17-d513-41b0-aa07-a324d17a0994)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443055cb-388b-40ce-a0ab-544abb39cde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443055cb-388b-40ce-a0ab-544abb39cde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15e951-7fa1-456c-8635-dc47eb59b90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15e951-7fa1-456c-8635-dc47eb59b90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a0af3b-341a-4022-8fa6-400751483da7', 'volume_name': 'volume-99a0af3b-341a-4022-8fa6-400751483da7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e718c2d2-97c1-46e4-af0b-224ce22b02f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e718c2d2-97c1-46e4-af0b-224ce22b02f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8946f94-cba9-4312-8726-8c0cbc61bc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:42 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Volume 99a0af3b-341a-4022-8fa6-400751483da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a0af3b-341a-4022-8fa6-400751483da7', 'volume_size': 1} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1dfdfa0-c6ba-4928-98ed-6bdd15ff292c,created_at=2026-09-07T07:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-16139382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1dfdfa0-c6ba-4928-98ed-6bdd15ff292c,host='devstack@QuobyteHD#QuobyteHD',id=99a0af3b-341a-4022-8fa6-400751483da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:42Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25529f17-d513-41b0-aa07-a324d17a0994),volume_type_id=25529f17-d513-41b0-aa07-a324d17a0994)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Creating volume 99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:45:42 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:42 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 1073741824 Sep 07 09:45:42 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:42 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 1073741824" returned: 0 in 0.543s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:42 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 Sep 07 09:45:42 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:43 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7" returned: 0 in 0.238s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:45:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8946f94-cba9-4312-8726-8c0cbc61bc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a0af3b-341a-4022-8fa6-400751483da7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296c2cc-bc2b-422b-a6e3-7cfea07a9150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:43 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Volume volume-99a0af3b-341a-4022-8fa6-400751483da7 (99a0af3b-341a-4022-8fa6-400751483da7): created successfully Sep 07 09:45:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296c2cc-bc2b-422b-a6e3-7cfea07a9150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (41b427b2-ce10-4899-b504-17952194b007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a83df79c-a5f4-4ac3-9b1d-80c13a44b3c9 tempest-GroupSnapshotsTest-899985263 None] Created volume successfully. Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (a26b7568-446f-4230-a951-bc08f4c2a3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dcddf96-fb59-43a4-a166-f475545d85f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dcddf96-fb59-43a4-a166-f475545d85f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-661380932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1dfdfa0-c6ba-4928-98ed-6bdd15ff292c,host='devstack@QuobyteHD#QuobyteHD',id=8d96ce44-283d-44df-9629-f985cda9c8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:44Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25529f17-d513-41b0-aa07-a324d17a0994),volume_type_id=25529f17-d513-41b0-aa07-a324d17a0994)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100f03d7-2124-4061-8851-49e7776e17e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100f03d7-2124-4061-8851-49e7776e17e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396e9dfe-63ca-4e1f-bfbd-cb16e91a0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396e9dfe-63ca-4e1f-bfbd-cb16e91a0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d96ce44-283d-44df-9629-f985cda9c8bd', 'volume_name': 'volume-8d96ce44-283d-44df-9629-f985cda9c8bd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fd2bbf-b687-4d67-8cf6-d585b7af2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fd2bbf-b687-4d67-8cf6-d585b7af2b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5454cd96-1d94-476a-a197-5af262167ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:44 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Volume 8d96ce44-283d-44df-9629-f985cda9c8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d96ce44-283d-44df-9629-f985cda9c8bd', 'volume_size': 1} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1dfdfa0-c6ba-4928-98ed-6bdd15ff292c,created_at=2026-09-07T07:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-661380932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1dfdfa0-c6ba-4928-98ed-6bdd15ff292c,host='devstack@QuobyteHD#QuobyteHD',id=8d96ce44-283d-44df-9629-f985cda9c8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:45:44Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25529f17-d513-41b0-aa07-a324d17a0994),volume_type_id=25529f17-d513-41b0-aa07-a324d17a0994)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Creating volume 8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:45:44 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:44 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd 1073741824 Sep 07 09:45:44 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:44 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd 1073741824" returned: 0 in 0.584s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:44 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd Sep 07 09:45:44 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:45 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd" returned: 0 in 0.308s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:45:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5454cd96-1d94-476a-a197-5af262167ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d96ce44-283d-44df-9629-f985cda9c8bd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d885262-3274-4a27-aa66-fcceb691bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:45:45 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Volume volume-8d96ce44-283d-44df-9629-f985cda9c8bd (8d96ce44-283d-44df-9629-f985cda9c8bd): created successfully Sep 07 09:45:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d885262-3274-4a27-aa66-fcceb691bf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:45:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (a26b7568-446f-4230-a951-bc08f4c2a3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:45:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9498a5d0-074e-460d-92c3-4883aaddfc1c tempest-GroupSnapshotsTest-899985263 None] Created volume successfully. Sep 07 09:45:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-194ca4f1-b6fd-4b19-a128-f48fa7c7d93f tempest-GroupSnapshotsTest-899985263 None] Update group completed successfully. Sep 07 09:45:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-725ff70f-68a2-4a25-96c4-1bb6048f985f tempest-GroupSnapshotsTest-899985263 None] Update group completed successfully. Sep 07 09:45:49 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-de44786d-1732-4cac-bd27-a8ceea537be8 tempest-GroupSnapshotsTest-899985263 None] Update group completed successfully. Sep 07 09:45:50 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1ecdac7d-7406-4467-a58b-2f9db6f68a15 tempest-GroupSnapshotsTest-899985263 None] Update group completed successfully. Sep 07 09:45:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] GroupSnapshot c31d321d-3921-491f-9db0-fb15f837413f: creating. Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Group snapshot c31d321d-3921-491f-9db0-fb15f837413f: creating. {{(pid=87290) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Creating offline snapshot 98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 of volume 99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[00caf331-8015-4bb7-8885-8fbfb7e4c3b7]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:52 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 Sep 07 09:45:52 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:52 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7" returned: 0 in 0.405s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:52 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 1G Sep 07 09:45:52 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:53 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 1G" returned: 0 in 0.572s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a0af3b-341a-4022-8fa6-400751483da7 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:53 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a0af3b-341a-4022-8fa6-400751483da7 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 Sep 07 09:45:53 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:53 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a0af3b-341a-4022-8fa6-400751483da7 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" returned: 0 in 0.378s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:53 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:45:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:53 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 Sep 07 09:45:53 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:53 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" returned: 0 in 0.262s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:53 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.info Sep 07 09:45:53 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:54 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.info" returned: 0 in 0.328s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:54 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:54 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.info Sep 07 09:45:54 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:54 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.info" returned: 0 in 0.336s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Creating offline snapshot b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 of volume 8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcf02f9-edcc-415c-a534-bfb82fe4e7dc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:54 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd Sep 07 09:45:54 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:54 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd" returned: 0 in 0.490s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:54 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 1G Sep 07 09:45:54 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:55 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 1G" returned: 0 in 0.558s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d96ce44-283d-44df-9629-f985cda9c8bd -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:55 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d96ce44-283d-44df-9629-f985cda9c8bd -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 Sep 07 09:45:55 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:55 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d96ce44-283d-44df-9629-f985cda9c8bd -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" returned: 0 in 0.358s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:55 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:45:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:55 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 Sep 07 09:45:55 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:56 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" returned: 0 in 0.436s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:56 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.info Sep 07 09:45:56 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:56 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.info" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:56 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:45:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:56 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.info Sep 07 09:45:56 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:56 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.info" returned: 0 in 0.294s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=95,cinder:UPDATE=74,cinder:DELETE=3,cinder:INSERT=13 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:45:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fa979980-c318-4d9a-9b16-be9987a5928e tempest-GroupSnapshotsTest-899985263 None] group_snapshot c31d321d-3921-491f-9db0-fb15f837413f: created successfully Sep 07 09:45:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] group_snapshot c31d321d-3921-491f-9db0-fb15f837413f: deleting Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] group_snapshot c31d321d-3921-491f-9db0-fb15f837413f: deleting {{(pid=87290) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-99a0af3b-341a-4022-8fa6-400751483da7" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-99a0af3b-341a-4022-8fa6-400751483da7" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Deleting offline snapshot 98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 of volume 99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] snapshot_file for this snap is: volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc9eea5-fa06-48c6-a677-01d4e3adeb1a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:57 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 Sep 07 09:45:57 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:58 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" returned: 0 in 0.514s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a0af3b-341a-4022-8fa6-400751483da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:45:58 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3f7595-b750-40a2-a73d-dcd4b0a75b85]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:58 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 Sep 07 09:45:58 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:58 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7" returned: 0 in 0.402s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:58 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 Sep 07 09:45:58 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:59 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" returned: 0 in 0.496s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:59 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9 Sep 07 09:45:59 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:45:59 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7.98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" returned: 0 in 0.339s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-98c33b43-3eb7-4fbe-ba8f-f18923cfe0b9" released by "_delete_snapshot" :: held 1.882s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-99a0af3b-341a-4022-8fa6-400751483da7" released by "delete_snapshot" :: held 1.917s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-8d96ce44-283d-44df-9629-f985cda9c8bd" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-8d96ce44-283d-44df-9629-f985cda9c8bd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Deleting offline snapshot b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 of volume 8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] snapshot_file for this snap is: volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb4df20-f556-4e1e-9715-ffe21e3d461c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:45:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:45:59 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 Sep 07 09:45:59 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:00 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" returned: 0 in 0.519s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d96ce44-283d-44df-9629-f985cda9c8bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:46:00 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897cc55-dea5-470e-8415-84909a14c153]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:00 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd Sep 07 09:46:00 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:00 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd" returned: 0 in 0.486s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:00 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 Sep 07 09:46:00 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:01 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" returned: 0 in 0.554s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:01 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6 Sep 07 09:46:01 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:01 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd.b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" returned: 0 in 0.440s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-b48f7b5b-95d8-4508-9bc3-5e06593a8ed6" released by "_delete_snapshot" :: held 2.137s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-8d96ce44-283d-44df-9629-f985cda9c8bd" released by "delete_snapshot" :: held 2.174s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:01 devstack cinder-volume[87290]: WARNING cinder.quota [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1057619322 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1057619322, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:01 devstack cinder-volume[87290]: WARNING cinder.quota [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1057619322 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1057619322, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:01 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Created reservations ['f9d68301-0f9a-4db7-a836-08f28003af5a', 'de373793-6121-4a75-840c-05cbfb064513', '73be7d5e-d14c-4464-bbf4-5df496c7a38f', 'dac6f90c-8fff-4b80-afa2-fa996c1cebb2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:02 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] Created reservations ['a04603b8-bafb-4a38-9148-c7e7c332c2ec', '896a634a-9539-459f-85df-ef5861899eea', '7efe5f03-890d-4210-927d-4f5f8d49934f', '649fbb2b-da82-4dd6-9200-2a71f03ca1db'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1f4249d1-e138-4460-80b4-f3d0287e268c tempest-GroupSnapshotsTest-899985263 None] group_snapshot c31d321d-3921-491f-9db0-fb15f837413f: deleted successfully Sep 07 09:46:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-8d96ce44-283d-44df-9629-f985cda9c8bd" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-8d96ce44-283d-44df-9629-f985cda9c8bd" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76de536-20a1-4f5b-be09-5a14c3e40365]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:03 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd Sep 07 09:46:03 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:03 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd" returned: 0 in 0.457s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:03 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd Sep 07 09:46:03 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:03 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d96ce44-283d-44df-9629-f985cda9c8bd" returned: 0 in 0.300s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-8d96ce44-283d-44df-9629-f985cda9c8bd" released by "delete_volume" :: held 0.876s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-99a0af3b-341a-4022-8fa6-400751483da7" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-99a0af3b-341a-4022-8fa6-400751483da7" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7dfb5e-8e94-4c0c-8d53-258e16b1d71d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:03 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 Sep 07 09:46:03 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:04 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7" returned: 0 in 0.473s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:04 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7 Sep 07 09:46:04 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:04 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-99a0af3b-341a-4022-8fa6-400751483da7" returned: 0 in 0.327s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-99a0af3b-341a-4022-8fa6-400751483da7" released by "delete_volume" :: held 0.871s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['fdd1493e-5753-481b-a8f6-607101892b50'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:04 devstack cinder-volume[87290]: WARNING cinder.quota [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1057619322 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1057619322, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['06f3e17b-1905-4db3-82a7-017b0cc81fd6', '4981efc8-24e1-4938-8822-0a58f25b432a', '6e3c0acd-7be5-4618-a2e3-554884dd410c', '9f3931d8-428f-45b8-a6e2-ad93ef93d098'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['e853ce45-1cc2-4fb6-8932-9c774d347970', '2d02afe6-de57-4869-9bdb-44a7342e5eb0', '63b187cc-dd49-471a-ae9d-40976b2e678b', '7aece79a-5ea5-4d14-aa6e-2bf6dbf8a426'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:05 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:46:05 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:05 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:05 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:46:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-717b9a31-4696-4a7d-bff9-0cdd149477e0 tempest-GroupSnapshotsTest-899985263 None] Delete group completed successfully. Sep 07 09:46:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d62a302c-a941-4ae8-9da2-fde8a839ac88 tempest-GroupSnapshotsTest-899985263 None] Group tempest-GroupSnapshotsTest-Group-91333592: creating Sep 07 09:46:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d62a302c-a941-4ae8-9da2-fde8a839ac88 tempest-GroupSnapshotsTest-899985263 None] Group tempest-GroupSnapshotsTest-Group-91333592: created successfully Sep 07 09:46:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d62a302c-a941-4ae8-9da2-fde8a839ac88 tempest-GroupSnapshotsTest-899985263 None] Create group completed successfully. Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=104,cinder:UPDATE=108,cinder:INSERT=24,cinder:DELETE=3 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (c8e432b1-bd3a-431d-b8b2-4f2ba05b950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3952e50d-4caa-497f-8e00-1e734d5d093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3952e50d-4caa-497f-8e00-1e734d5d093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-520957946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05e1c43b-5a84-4230-a7b8-c741c2bd6c0a,host='devstack@QuobyteHD#QuobyteHD',id=04240ca6-4e98-41b2-a5af-5682ad81af7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:09Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c66f3e43-961b-4d13-9188-77abbab02884),volume_type_id=c66f3e43-961b-4d13-9188-77abbab02884)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae18788-3956-4ab8-b044-327ebd1fb1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae18788-3956-4ab8-b044-327ebd1fb1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778dd237-fa40-4a62-b5fb-f256c3827b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778dd237-fa40-4a62-b5fb-f256c3827b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04240ca6-4e98-41b2-a5af-5682ad81af7c', 'volume_name': 'volume-04240ca6-4e98-41b2-a5af-5682ad81af7c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1984d98d-1f02-4f7b-8a19-127b8a9a5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1984d98d-1f02-4f7b-8a19-127b8a9a5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650596eb-e637-436a-a238-2ea2c37e3372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Volume 04240ca6-4e98-41b2-a5af-5682ad81af7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04240ca6-4e98-41b2-a5af-5682ad81af7c', 'volume_size': 1} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05e1c43b-5a84-4230-a7b8-c741c2bd6c0a,created_at=2026-09-07T07:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-520957946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05e1c43b-5a84-4230-a7b8-c741c2bd6c0a,host='devstack@QuobyteHD#QuobyteHD',id=04240ca6-4e98-41b2-a5af-5682ad81af7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3fa7c74f24267a0d24734169d0201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:09Z,use_quota=True,user_id='25e68e18aeb14d2eb5d42ca7d65311e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c66f3e43-961b-4d13-9188-77abbab02884),volume_type_id=c66f3e43-961b-4d13-9188-77abbab02884)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Creating volume 04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:46:08 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:46:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:08 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c 1073741824 Sep 07 09:46:08 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:09 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c 1073741824" returned: 0 in 0.764s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:09 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c Sep 07 09:46:09 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:09 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c" returned: 0 in 0.339s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:46:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650596eb-e637-436a-a238-2ea2c37e3372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04240ca6-4e98-41b2-a5af-5682ad81af7c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a47ee5-77c3-436d-a3e5-0e3997357ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Volume volume-04240ca6-4e98-41b2-a5af-5682ad81af7c (04240ca6-4e98-41b2-a5af-5682ad81af7c): created successfully Sep 07 09:46:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a47ee5-77c3-436d-a3e5-0e3997357ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Flow 'volume_create_manager' (c8e432b1-bd3a-431d-b8b2-4f2ba05b950c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-293ea5ad-c15c-4df0-a422-f5c32ca503f0 tempest-GroupSnapshotsTest-899985263 None] Created volume successfully. Sep 07 09:46:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] GroupSnapshot 6b941582-44b9-48f9-9007-ccb9c70ce207: creating. Sep 07 09:46:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Group snapshot 6b941582-44b9-48f9-9007-ccb9c70ce207: creating. {{(pid=87290) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 09:46:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Creating offline snapshot 6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 of volume 04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:46:12 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8dda95-79b1-4e4f-8d43-817a653cde29]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:12 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c Sep 07 09:46:12 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:13 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c" returned: 0 in 0.959s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:13 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 1G Sep 07 09:46:13 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:14 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 1G" returned: 0 in 1.250s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04240ca6-4e98-41b2-a5af-5682ad81af7c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:14 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04240ca6-4e98-41b2-a5af-5682ad81af7c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 Sep 07 09:46:14 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:14 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04240ca6-4e98-41b2-a5af-5682ad81af7c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" returned: 0 in 0.496s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:14 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:46:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:14 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 Sep 07 09:46:14 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:15 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" returned: 0 in 0.988s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:15 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.info Sep 07 09:46:15 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:16 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.info" returned: 0 in 0.572s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:16 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:46:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:16 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.info Sep 07 09:46:16 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:17 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.info" returned: 0 in 0.679s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.136s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-004eb449-d0a6-4361-91ae-79026daa5725 tempest-GroupSnapshotsTest-899985263 None] group_snapshot 6b941582-44b9-48f9-9007-ccb9c70ce207: created successfully Sep 07 09:46:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] group_snapshot 6b941582-44b9-48f9-9007-ccb9c70ce207: deleting Sep 07 09:46:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] group_snapshot 6b941582-44b9-48f9-9007-ccb9c70ce207: deleting {{(pid=87290) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-04240ca6-4e98-41b2-a5af-5682ad81af7c" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-04240ca6-4e98-41b2-a5af-5682ad81af7c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Deleting offline snapshot 6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 of volume 04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] snapshot_file for this snap is: volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4b4a5b-5dab-40ec-9d5c-f9bec8da1d7d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:18 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 Sep 07 09:46:18 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:18 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" returned: 0 in 0.560s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04240ca6-4e98-41b2-a5af-5682ad81af7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24d165a-b73f-41c8-a124-27b0e8c9bdd5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:18 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c Sep 07 09:46:18 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:19 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c" returned: 0 in 0.909s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:19 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 Sep 07 09:46:19 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:20 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" returned: 0 in 0.926s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:20 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0 Sep 07 09:46:20 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:21 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c.6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" returned: 0 in 0.597s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-6c2c1480-91fe-4d7c-ac22-f9dadc46b5a0" released by "_delete_snapshot" :: held 3.152s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-04240ca6-4e98-41b2-a5af-5682ad81af7c" released by "delete_snapshot" :: held 3.191s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:21 devstack cinder-volume[87290]: WARNING cinder.quota [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2113219893 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2113219893, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:21 devstack cinder-volume[87290]: WARNING cinder.quota [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2113219893 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2113219893, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:21 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['b27e491f-d24b-43e5-99b8-48aee4a57d8a', '7ea960a4-f6c4-4ce1-9f7a-35ffed82ec94', 'ab917fab-3d68-4c9f-a965-96dd5d788d2d', 'b493bba9-9962-4770-908b-f69d14bdb347'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-dd922e40-b1ee-4efe-b56b-f1a5a53f7ea5 tempest-GroupSnapshotsTest-899985263 None] group_snapshot 6b941582-44b9-48f9-9007-ccb9c70ce207: deleted successfully Sep 07 09:46:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "cinder-quobyte-04240ca6-4e98-41b2-a5af-5682ad81af7c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-04240ca6-4e98-41b2-a5af-5682ad81af7c" acquired by "delete_volume" :: waited 0.053s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[219de417-e9fd-4147-96eb-b0d1e7dbe420]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:24 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c Sep 07 09:46:24 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:25 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c" returned: 0 in 1.024s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:25 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c Sep 07 09:46:25 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:25 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04240ca6-4e98-41b2-a5af-5682ad81af7c" returned: 0 in 0.712s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Lock "cinder-quobyte-04240ca6-4e98-41b2-a5af-5682ad81af7c" released by "delete_volume" :: held 1.880s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:25 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['71b8e129-22b7-4a9a-af0d-7e42c2f8910a'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:25 devstack cinder-volume[87290]: WARNING cinder.quota [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2113219893 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2113219893, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Created reservations ['b9413675-2344-4f35-abcb-f01d2a03e885', '80f6e6d3-8ee5-43d3-b6b4-267472742efb', '26b097b0-e8cc-481b-9088-177d2251c772', '8ef5cf5d-3e66-436f-b42c-601781fd02c6'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:26 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:46:26 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:26 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.390s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:26 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:46:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-58678be4-7675-4ed5-8e8b-2e4d34cc21b1 tempest-GroupSnapshotsTest-899985263 None] Delete group completed successfully. Sep 07 09:46:36 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=26,cinder:INSERT=4,cinder:UPDATE=22 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:46:36 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=50,cinder:UPDATE=48,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Flow 'volume_create_manager' (8f19e76a-0e63-48e7-af9c-56b125d4ea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fe1eb0-7b39-4d4a-b5af-5a600a912d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fe1eb0-7b39-4d4a-b5af-5a600a912d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1678694827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77f5ef0-58f7-498a-a6b4-10201fdd4af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e80f615490644d8ac3dd569dfaca606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:37Z,use_quota=True,user_id='ea66b0aae67945a5ad84e84bb1bf5f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef2eacf-9b30-437c-9614-f5e8204627f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef2eacf-9b30-437c-9614-f5e8204627f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629006bb-5e69-4566-b929-9d0239a53366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629006bb-5e69-4566-b929-9d0239a53366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77f5ef0-58f7-498a-a6b4-10201fdd4af7', 'volume_name': 'volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0685dc18-eabf-4fd2-a2a9-adae1f36e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0685dc18-eabf-4fd2-a2a9-adae1f36e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6470570c-6041-45c1-882e-0325e4fdf5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:37 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Volume e77f5ef0-58f7-498a-a6b4-10201fdd4af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7', 'volume_size': 1} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1678694827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77f5ef0-58f7-498a-a6b4-10201fdd4af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e80f615490644d8ac3dd569dfaca606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:37Z,use_quota=True,user_id='ea66b0aae67945a5ad84e84bb1bf5f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Creating volume e77f5ef0-58f7-498a-a6b4-10201fdd4af7 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:46:37 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:37 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 1073741824 Sep 07 09:46:37 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:37 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 1073741824" returned: 0 in 0.576s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:37 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 Sep 07 09:46:37 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:38 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7" returned: 0 in 0.410s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:46:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6470570c-6041-45c1-882e-0325e4fdf5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e358f10-5c35-4f04-ad78-74b0bb4dd0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:38 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Volume volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 (e77f5ef0-58f7-498a-a6b4-10201fdd4af7): created successfully Sep 07 09:46:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e358f10-5c35-4f04-ad78-74b0bb4dd0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Flow 'volume_create_manager' (8f19e76a-0e63-48e7-af9c-56b125d4ea9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b844d921-389b-4d3c-b8fa-70745c91fe3b tempest-ServersNegativeTestJSON-1305130783 None] Created volume successfully. Sep 07 09:46:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4c518943-2c4e-432f-bcbd-007a70ea7ed9 tempest-GroupsV314Test-321008997 None] Group tempest-GroupsV314Test-Group-1953131030: creating Sep 07 09:46:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4c518943-2c4e-432f-bcbd-007a70ea7ed9 tempest-GroupsV314Test-321008997 None] Group tempest-GroupsV314Test-Group-1953131030: created successfully Sep 07 09:46:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4c518943-2c4e-432f-bcbd-007a70ea7ed9 tempest-GroupsV314Test-321008997 None] Create group completed successfully. Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Flow 'volume_create_manager' (a16e6f3a-68c1-447d-8a1f-259899210cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6313374-e781-4f7c-b239-ced38905fb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6313374-e781-4f7c-b239-ced38905fb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-660694641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3fe6e1-1b95-4416-b89e-a0e394aa241c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e80f615490644d8ac3dd569dfaca606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:41Z,use_quota=True,user_id='ea66b0aae67945a5ad84e84bb1bf5f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0633e1-bcb9-42e9-9ecf-e9411f5fcb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0633e1-bcb9-42e9-9ecf-e9411f5fcb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5bc81a-a927-4246-a26b-ee7179c04b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5bc81a-a927-4246-a26b-ee7179c04b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3fe6e1-1b95-4416-b89e-a0e394aa241c', 'volume_name': 'volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b0b754-b800-4c8f-bad9-84bb5a0ec78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b0b754-b800-4c8f-bad9-84bb5a0ec78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0500b224-d713-4709-bd9d-ee23212fee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Volume 2d3fe6e1-1b95-4416-b89e-a0e394aa241c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c', 'volume_size': 1} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-660694641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3fe6e1-1b95-4416-b89e-a0e394aa241c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e80f615490644d8ac3dd569dfaca606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:41Z,use_quota=True,user_id='ea66b0aae67945a5ad84e84bb1bf5f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Creating volume 2d3fe6e1-1b95-4416-b89e-a0e394aa241c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:46:40 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:40 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c 1073741824 Sep 07 09:46:40 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Flow 'volume_create_manager' (536d4416-5ada-4137-ad77-f93036690430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a2ef6c-995f-41fb-86de-833dac8c7b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a2ef6c-995f-41fb-86de-833dac8c7b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1643609456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=951a9a98-37a9-43a9-b758-44b913a7d275,host='devstack@QuobyteHD#QuobyteHD',id=b95601e7-4702-4f7d-9837-5baaa812444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e122869be1034d7eaee1ce3a993b5706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:41Z,use_quota=True,user_id='262dd069def349cd9aa1542d7972004e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9788fd70-2c80-430c-a70c-7e5b6ef3e703),volume_type_id=9788fd70-2c80-430c-a70c-7e5b6ef3e703)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19251ae-093f-4424-9802-6813cf9099e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19251ae-093f-4424-9802-6813cf9099e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2021868-3698-43c5-9557-e81d74938bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2021868-3698-43c5-9557-e81d74938bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95601e7-4702-4f7d-9837-5baaa812444e', 'volume_name': 'volume-b95601e7-4702-4f7d-9837-5baaa812444e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ed7e12-121e-46df-8523-b02eda4d6723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ed7e12-121e-46df-8523-b02eda4d6723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0320a2-f90c-47ec-b0cc-12500a7064eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Volume b95601e7-4702-4f7d-9837-5baaa812444e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95601e7-4702-4f7d-9837-5baaa812444e', 'volume_size': 1} Sep 07 09:46:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:41 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:46:41 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:41 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c 1073741824" returned: 0 in 0.440s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:41 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c Sep 07 09:46:41 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:41 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.278s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 8 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:46:41 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c" returned: 0 in 0.296s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=951a9a98-37a9-43a9-b758-44b913a7d275,created_at=2026-09-07T07:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1643609456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=951a9a98-37a9-43a9-b758-44b913a7d275,host='devstack@QuobyteHD#QuobyteHD',id=b95601e7-4702-4f7d-9837-5baaa812444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e122869be1034d7eaee1ce3a993b5706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:41Z,use_quota=True,user_id='262dd069def349cd9aa1542d7972004e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9788fd70-2c80-430c-a70c-7e5b6ef3e703),volume_type_id=9788fd70-2c80-430c-a70c-7e5b6ef3e703)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Creating volume b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:46:41 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:41 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e 1073741824 Sep 07 09:46:41 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0500b224-d713-4709-bd9d-ee23212fee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7774d07b-25d8-445f-93d6-ed968e2281af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:41 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Volume volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c (2d3fe6e1-1b95-4416-b89e-a0e394aa241c): created successfully Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7774d07b-25d8-445f-93d6-ed968e2281af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Flow 'volume_create_manager' (a16e6f3a-68c1-447d-8a1f-259899210cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:41 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8887d1ae-92a5-425b-b5d7-0e3384583120 tempest-ServersNegativeTestJSON-1305130783 None] Created volume successfully. Sep 07 09:46:41 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e 1073741824" returned: 0 in 0.405s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:42 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e Sep 07 09:46:42 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:42 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e" returned: 0 in 0.242s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0320a2-f90c-47ec-b0cc-12500a7064eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95601e7-4702-4f7d-9837-5baaa812444e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21025ee4-69f3-48a7-8e63-7953f06cab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:42 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Volume volume-b95601e7-4702-4f7d-9837-5baaa812444e (b95601e7-4702-4f7d-9837-5baaa812444e): created successfully Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21025ee4-69f3-48a7-8e63-7953f06cab72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Flow 'volume_create_manager' (536d4416-5ada-4137-ad77-f93036690430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-895d61ed-2b70-41ba-9abd-949e6340ab4e tempest-GroupsV314Test-321008997 None] Created volume successfully. Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "cinder-2d3fe6e1-1b95-4416-b89e-a0e394aa241c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-2d3fe6e1-1b95-4416-b89e-a0e394aa241c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "cinder-quobyte-2d3fe6e1-1b95-4416-b89e-a0e394aa241c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-quobyte-2d3fe6e1-1b95-4416-b89e-a0e394aa241c" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f29622-1834-4012-834b-8860a103a055]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:43 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c Sep 07 09:46:43 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:43 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c" returned: 0 in 0.379s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:43 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c Sep 07 09:46:43 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:43 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Cloning volume b95601e7-4702-4f7d-9837-5baaa812444e to volume 50c81663-1035-428f-81e6-781108b60ff0 Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Creating offline snapshot 72d84822-d92d-4526-813e-44a3ce7282db of volume b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[33284d57-8333-4a9a-9b13-16ae90c09851]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:43 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d3fe6e1-1b95-4416-b89e-a0e394aa241c" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-quobyte-2d3fe6e1-1b95-4416-b89e-a0e394aa241c" released by "delete_volume" :: held 0.683s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:43 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e Sep 07 09:46:43 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Created reservations ['26b70cc5-d198-4f85-98f7-5ca962ddd087', 'aa889c6c-4129-42c7-aaf6-817bc13b8e6e', 'c866475b-0057-4cf9-85ba-b41499c1a450', 'f3688387-84e8-4372-99d8-08511b2f88ba'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:43 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:46:43 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:43 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e" returned: 0 in 0.429s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:43 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db 1G Sep 07 09:46:43 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "cinder-e77f5ef0-58f7-498a-a6b4-10201fdd4af7-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-e77f5ef0-58f7-498a-a6b4-10201fdd4af7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:44 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:46:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Deleted volume successfully. Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0719bc35-c590-4692-8b6d-c503f7a18520 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-2d3fe6e1-1b95-4416-b89e-a0e394aa241c-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "cinder-quobyte-e77f5ef0-58f7-498a-a6b4-10201fdd4af7" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-quobyte-e77f5ef0-58f7-498a-a6b4-10201fdd4af7" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[38023143-2c0d-4a4a-80d0-f3dcd674b6b5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:44 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 Sep 07 09:46:44 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:44 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db 1G" returned: 0 in 0.485s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95601e7-4702-4f7d-9837-5baaa812444e -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:44 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95601e7-4702-4f7d-9837-5baaa812444e -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db Sep 07 09:46:44 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:44 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7" returned: 0 in 0.389s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:44 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7 Sep 07 09:46:44 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:44 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95601e7-4702-4f7d-9837-5baaa812444e -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db" returned: 0 in 0.334s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:44 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:44 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db Sep 07 09:46:44 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:44 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e77f5ef0-58f7-498a-a6b4-10201fdd4af7" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-quobyte-e77f5ef0-58f7-498a-a6b4-10201fdd4af7" released by "delete_volume" :: held 0.714s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Created reservations ['ba50fcd0-acc0-4505-a5e5-10360c21405f', '5d44633e-196d-4c5b-b486-024f0bf41ee6', 'a175a807-81ab-4af2-a04a-6aa995fb505e', '2679f0dd-6561-423f-b898-4ff291e6e4d4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:45 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:46:45 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:45 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:45 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.info Sep 07 09:46:45 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:45 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.273s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:46:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Deleted volume successfully. Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-26c63411-fab0-4637-bc41-e3cedb5edad4 tempest-ServersNegativeTestJSON-1305130783 None] Lock "cinder-e77f5ef0-58f7-498a-a6b4-10201fdd4af7-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:45 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.info" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:45 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:45 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.info Sep 07 09:46:45 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:45 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.info" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Acquiring lock "cinder-quobyte-50c81663-1035-428f-81e6-781108b60ff0" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-50c81663-1035-428f-81e6-781108b60ff0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] snapshot: 72d84822-d92d-4526-813e-44a3ce7282db, volume: 50c81663-1035-428f-81e6-781108b60ff0, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f34c7-0d67-4bd1-88df-12792770729d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:45 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db Sep 07 09:46:45 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:46 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db" returned: 0 in 0.526s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95601e7-4702-4f7d-9837-5baaa812444e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53d6613-7dd9-4dbd-a314-7bdc53af1e9a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:46 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e Sep 07 09:46:46 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:46 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e" returned: 0 in 0.465s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:46:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:46 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 Sep 07 09:46:46 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:50 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Flow 'volume_create_manager' (2a984d38-53a5-4370-8c77-db620915af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69297025-59e8-46e5-b785-05963175b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69297025-59e8-46e5-b785-05963175b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751675944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f757b18-8cea-49c8-b922-08c89ff6bab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddaf88201314b20b59c79628ff208b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:51Z,use_quota=True,user_id='f713f4b61fb74306a55e670d44a06d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305ff950-061d-47ca-b030-c73f871e9755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305ff950-061d-47ca-b030-c73f871e9755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0014800b-aa33-4c52-942a-c1c839aa2858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0014800b-aa33-4c52-942a-c1c839aa2858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f757b18-8cea-49c8-b922-08c89ff6bab4', 'volume_name': 'volume-2f757b18-8cea-49c8-b922-08c89ff6bab4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f104fdc-d16e-4799-b68e-96f8f56f80a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f104fdc-d16e-4799-b68e-96f8f56f80a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a230097-daba-4e1a-8d94-5f7927bac5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:51 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Volume 2f757b18-8cea-49c8-b922-08c89ff6bab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f757b18-8cea-49c8-b922-08c89ff6bab4', 'volume_size': 1} Sep 07 09:46:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:53 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0" returned: 0 in 6.366s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:46:53 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Converted 1024.00 MB image at 160.77 MB/s Sep 07 09:46:53 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:53 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 Sep 07 09:46:53 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Flow 'volume_create_manager' (95ca2b0f-731b-4619-a4b6-179756888641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816a30d3-abc9-4790-a6c7-b0f5fe987a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816a30d3-abc9-4790-a6c7-b0f5fe987a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-127611479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc71185-971d-4019-9090-477700edf19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e515c38335b4f5baa626ea1eceb641d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:53Z,use_quota=True,user_id='c0d0f2d97e254e0480b7b32c24d4a712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4192e-c217-46ee-b382-9567cb8a4773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4192e-c217-46ee-b382-9567cb8a4773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536c112a-5ecf-4f06-aed4-9155b92cd8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536c112a-5ecf-4f06-aed4-9155b92cd8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc71185-971d-4019-9090-477700edf19b', 'volume_name': 'volume-4cc71185-971d-4019-9090-477700edf19b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cb6e67-8df3-4e9e-8ab4-c671829f0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cb6e67-8df3-4e9e-8ab4-c671829f0e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:53 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec3c027-1ebe-4f90-9798-f0b715fa81e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:53 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Volume 4cc71185-971d-4019-9090-477700edf19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc71185-971d-4019-9090-477700edf19b', 'volume_size': 1} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0" returned: 0 in 0.328s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-50c81663-1035-428f-81e6-781108b60ff0" released by "_copy_volume_from_snapshot" :: held 7.782s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Acquiring lock "cinder-quobyte-72d84822-d92d-4526-813e-44a3ce7282db" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-72d84822-d92d-4526-813e-44a3ce7282db" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Deleting offline snapshot 72d84822-d92d-4526-813e-44a3ce7282db of volume b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] snapshot_file for this snap is: volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[40241bbe-ae74-4359-a825-d1a6a457a1c5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:53 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db Sep 07 09:46:53 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:53 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db" returned: 0 in 0.384s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95601e7-4702-4f7d-9837-5baaa812444e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a71a24-72a9-45e3-a30a-3e72a701c1b4]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:54 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e Sep 07 09:46:54 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:54 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e" returned: 0 in 0.639s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:54 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db Sep 07 09:46:54 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:54 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db" returned: 0 in 0.376s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:54 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db Sep 07 09:46:54 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:55 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e.72d84822-d92d-4526-813e-44a3ce7282db" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-72d84822-d92d-4526-813e-44a3ce7282db" released by "_delete_snapshot" :: held 1.777s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.825s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.081s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751675944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f757b18-8cea-49c8-b922-08c89ff6bab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddaf88201314b20b59c79628ff208b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:51Z,use_quota=True,user_id='f713f4b61fb74306a55e670d44a06d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Creating volume 2f757b18-8cea-49c8-b922-08c89ff6bab4 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:46:55 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:55 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 1073741824 Sep 07 09:46:55 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6d3bf0d4-c89f-4bba-ad23-79d9c6ae3bab tempest-GroupsV314Test-321008997 None] Create group from source-group-951a9a98-37a9-43a9-b758-44b913a7d275 completed successfully. Sep 07 09:46:55 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 1073741824" returned: 0 in 0.649s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:56 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 Sep 07 09:46:56 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Acquiring lock "cinder-quobyte-50c81663-1035-428f-81e6-781108b60ff0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-50c81663-1035-428f-81e6-781108b60ff0" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2005edc3-b149-4f15-ad3d-a9e8c74747f1]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:56 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 Sep 07 09:46:56 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:56 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4" returned: 0 in 0.529s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.116s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-127611479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc71185-971d-4019-9090-477700edf19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e515c38335b4f5baa626ea1eceb641d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:46:53Z,use_quota=True,user_id='c0d0f2d97e254e0480b7b32c24d4a712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Creating volume 4cc71185-971d-4019-9090-477700edf19b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:46:56 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:56 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b 1073741824 Sep 07 09:46:56 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a230097-daba-4e1a-8d94-5f7927bac5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f757b18-8cea-49c8-b922-08c89ff6bab4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54a49e8-3ea9-48d6-9d79-3b7395b8b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Volume volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 (2f757b18-8cea-49c8-b922-08c89ff6bab4): created successfully Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54a49e8-3ea9-48d6-9d79-3b7395b8b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Flow 'volume_create_manager' (2a984d38-53a5-4370-8c77-db620915af96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-18b6abe5-6c85-409a-aa35-08fa8a8ffa7a tempest-AttachVolumeTestJSON-728167824 None] Created volume successfully. Sep 07 09:46:56 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0" returned: 0 in 0.611s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:56 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0 Sep 07 09:46:56 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:57 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b 1073741824" returned: 0 in 0.664s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:57 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-50c81663-1035-428f-81e6-781108b60ff0" returned: 0 in 0.354s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-50c81663-1035-428f-81e6-781108b60ff0" released by "delete_volume" :: held 1.041s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:57 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b Sep 07 09:46:57 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Created reservations ['acbc8b60-50b8-4392-9065-29de9eacf5d2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:57 devstack cinder-volume[87290]: WARNING cinder.quota [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-8360211 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-8360211, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:57 devstack cinder-volume[87290]: WARNING cinder.quota [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-8360211 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-8360211, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Created reservations ['825be132-bf55-40c7-8cee-6a3cde395781', '93ace68d-0351-42ed-8fbe-f9d8a494f5f1', '433216d1-627c-41b0-b878-817c0bb81b54', '52e22550-bd87-4519-ade6-035d1568f26f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:57 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:46:57 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:57 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b" returned: 0 in 0.426s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec3c027-1ebe-4f90-9798-f0b715fa81e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc71185-971d-4019-9090-477700edf19b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edea9e18-0119-41c9-b18a-fdd0fc441487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:46:57 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Volume volume-4cc71185-971d-4019-9090-477700edf19b (4cc71185-971d-4019-9090-477700edf19b): created successfully Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edea9e18-0119-41c9-b18a-fdd0fc441487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:46:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Flow 'volume_create_manager' (95ca2b0f-731b-4619-a4b6-179756888641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:46:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-239c7902-3af1-40ed-a016-22d0aeaf484d tempest-ServerActionsTestOtherA-511722583 None] Created volume successfully. Sep 07 09:46:58 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.551s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:46:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-83e10450-81d2-4df3-8d3c-7c48fa1d32fe tempest-GroupsV314Test-321008997 None] Delete group completed successfully. Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Acquiring lock "cinder-quobyte-b95601e7-4702-4f7d-9837-5baaa812444e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-b95601e7-4702-4f7d-9837-5baaa812444e" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[654336e1-fcee-4853-985e-6d9bac85a189]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-c755fcce-3afa-40ad-a0b7-e89c24b6d416 req-8a6c131c-83ad-4ec1-9602-cd53603a58ef tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-c755fcce-3afa-40ad-a0b7-e89c24b6d416 req-8a6c131c-83ad-4ec1-9602-cd53603a58ef tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-c755fcce-3afa-40ad-a0b7-e89c24b6d416 req-8a6c131c-83ad-4ec1-9602-cd53603a58ef tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:58 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e Sep 07 09:46:58 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-c755fcce-3afa-40ad-a0b7-e89c24b6d416 req-8a6c131c-83ad-4ec1-9602-cd53603a58ef tempest-AttachVolumeTestJSON-728167824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-2f757b18-8cea-49c8-b922-08c89ff6bab4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e44363bd-6e5c-4cb2-8722-da11d2433fae', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:46:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-c755fcce-3afa-40ad-a0b7-e89c24b6d416 req-8a6c131c-83ad-4ec1-9602-cd53603a58ef tempest-AttachVolumeTestJSON-728167824 None] attachment_update completed successfully. Sep 07 09:46:58 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e" returned: 0 in 0.542s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:58 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e Sep 07 09:46:58 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:46:59 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b95601e7-4702-4f7d-9837-5baaa812444e" returned: 0 in 0.333s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Lock "cinder-quobyte-b95601e7-4702-4f7d-9837-5baaa812444e" released by "delete_volume" :: held 0.993s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Created reservations ['e2059f0b-83ee-42b2-9f02-840d2646db60'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Created reservations ['d547b483-5c51-4485-a707-1cc802f7d8ca', '3ac1e03a-38a0-4071-86c9-376c6b89c4bf', 'c7315632-0bac-4f08-9807-07982ddca8d5', '1eb395e2-19b6-49c1-86cb-29386e6f9f09'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:46:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:46:59 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:46:59 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:00 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.445s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:00 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:00 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b87a0e23-58c5-4060-be50-428c1f1c9658 tempest-GroupsV314Test-321008997 None] Delete group completed successfully. Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Flow 'volume_create_manager' (87e43e30-39e1-40e4-bf33-4ce9bce74407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3d560c-64d5-4907-b46f-cf456597038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3d560c-64d5-4907-b46f-cf456597038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1529129687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddaf88201314b20b59c79628ff208b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:01Z,use_quota=True,user_id='f713f4b61fb74306a55e670d44a06d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27167646-b809-4d95-8a24-22a1b1399dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27167646-b809-4d95-8a24-22a1b1399dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7526bdbf-924c-4038-b385-72c13adf8aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7526bdbf-924c-4038-b385-72c13adf8aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00', 'volume_name': 'volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7089889a-0168-4d90-9e99-0805cbf1ef77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7089889a-0168-4d90-9e99-0805cbf1ef77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808a852f-626d-431f-9e42-9c37d5780db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:01 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Volume bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00', 'volume_size': 1} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1529129687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddaf88201314b20b59c79628ff208b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:01Z,use_quota=True,user_id='f713f4b61fb74306a55e670d44a06d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Creating volume bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:47:01 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:01 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 1073741824 Sep 07 09:47:01 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:01 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 1073741824" returned: 0 in 0.646s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:02 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 Sep 07 09:47:02 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:02 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00" returned: 0 in 0.335s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808a852f-626d-431f-9e42-9c37d5780db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3036ee2-b730-4598-baa7-f9da575b612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:02 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Volume volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 (bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00): created successfully Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3036ee2-b730-4598-baa7-f9da575b612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Flow 'volume_create_manager' (87e43e30-39e1-40e4-bf33-4ce9bce74407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-22394c23-9add-40fc-8407-0a1df8398437 tempest-AttachVolumeTestJSON-728167824 None] Created volume successfully. Sep 07 09:47:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2408408f-6923-44da-aff2-c7833d6dc7d4 tempest-GroupsTest-1534522660 None] Group tempest-Group1-1255318395: creating Sep 07 09:47:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2408408f-6923-44da-aff2-c7833d6dc7d4 tempest-GroupsTest-1534522660 None] Group tempest-Group1-1255318395: created successfully Sep 07 09:47:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2408408f-6923-44da-aff2-c7833d6dc7d4 tempest-GroupsTest-1534522660 None] Create group completed successfully. Sep 07 09:47:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-9e8814c5-e37d-43ac-905c-4bf498560ef4 req-7dbfd027-51c8-4cf5-9dee-8e3c62d79830 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-9e8814c5-e37d-43ac-905c-4bf498560ef4 req-7dbfd027-51c8-4cf5-9dee-8e3c62d79830 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-9e8814c5-e37d-43ac-905c-4bf498560ef4 req-7dbfd027-51c8-4cf5-9dee-8e3c62d79830 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-9e8814c5-e37d-43ac-905c-4bf498560ef4 req-7dbfd027-51c8-4cf5-9dee-8e3c62d79830 tempest-AttachVolumeTestJSON-728167824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ccb1254-02f3-4e9d-b02c-be160abbfc6b', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:47:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-9e8814c5-e37d-43ac-905c-4bf498560ef4 req-7dbfd027-51c8-4cf5-9dee-8e3c62d79830 tempest-AttachVolumeTestJSON-728167824 None] attachment_update completed successfully. Sep 07 09:47:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-eb46eec3-8006-42e0-a797-e56aaf44c207 tempest-GroupsTest-1534522660 None] Group tempest-Group2-523546816: creating Sep 07 09:47:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-eb46eec3-8006-42e0-a797-e56aaf44c207 tempest-GroupsTest-1534522660 None] Group tempest-Group2-523546816: created successfully Sep 07 09:47:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-eb46eec3-8006-42e0-a797-e56aaf44c207 tempest-GroupsTest-1534522660 None] Create group completed successfully. Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Flow 'volume_create_manager' (f1273358-a371-4815-9e68-31f563dc5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082edec6-d5da-42e6-8ab6-1750c3e9e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082edec6-d5da-42e6-8ab6-1750c3e9e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951948779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b432156-b357-457e-b0f9-7112d75e3e34,host='devstack@QuobyteHD#QuobyteHD',id=ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85c81a5fd03484ba46a93f33219fdb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:07Z,use_quota=True,user_id='560a8f1be540437fa57f3a789ac84721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56dcbcc4-5b49-4513-8b6e-c31dc5dd0723),volume_type_id=56dcbcc4-5b49-4513-8b6e-c31dc5dd0723)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c920816f-e146-4013-810f-1d298aec4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c920816f-e146-4013-810f-1d298aec4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5901dffa-a6b5-46e2-8273-01b0dfe0b919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5901dffa-a6b5-46e2-8273-01b0dfe0b919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4', 'volume_name': 'volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8169be86-35f4-4e01-893b-acdac3e24c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8169be86-35f4-4e01-893b-acdac3e24c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723628a4-3c35-4665-9d00-37a00cbe14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:06 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Volume ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4', 'volume_size': 1} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b432156-b357-457e-b0f9-7112d75e3e34,created_at=2026-09-07T07:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951948779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b432156-b357-457e-b0f9-7112d75e3e34,host='devstack@QuobyteHD#QuobyteHD',id=ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85c81a5fd03484ba46a93f33219fdb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:07Z,use_quota=True,user_id='560a8f1be540437fa57f3a789ac84721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56dcbcc4-5b49-4513-8b6e-c31dc5dd0723),volume_type_id=56dcbcc4-5b49-4513-8b6e-c31dc5dd0723)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Creating volume ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:47:06 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:47:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:06 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 1073741824 Sep 07 09:47:06 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:07 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 1073741824" returned: 0 in 0.804s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:07 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 Sep 07 09:47:07 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-3095d03e-8961-4034-9ad6-1b7d5c3a8e8d req-9c3b0aed-d8ce-413f-9272-a5e05d0f41d4 tempest-AttachVolumeTestJSON-728167824 None] Terminate volume connection completed successfully. Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-3095d03e-8961-4034-9ad6-1b7d5c3a8e8d req-9c3b0aed-d8ce-413f-9272-a5e05d0f41d4 tempest-AttachVolumeTestJSON-728167824 None] Deleting attachment e44363bd-6e5c-4cb2-8722-da11d2433fae. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:47:08 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4" returned: 0 in 0.480s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723628a4-3c35-4665-9d00-37a00cbe14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f1e328-3a28-4e49-8afb-a430cc7367a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Volume volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 (ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4): created successfully Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f1e328-3a28-4e49-8afb-a430cc7367a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Flow 'volume_create_manager' (f1273358-a371-4815-9e68-31f563dc5e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c75a0f21-c2a6-446c-af2a-7fc48e7fcbf8 tempest-GroupsTest-1534522660 None] Created volume successfully. Sep 07 09:47:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-e6e023b1-99c6-489d-a517-a6a11141ad20 req-83e48b00-6a71-4713-b0a0-afc022be71ef tempest-AttachVolumeTestJSON-728167824 None] Terminate volume connection completed successfully. Sep 07 09:47:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-e6e023b1-99c6-489d-a517-a6a11141ad20 req-83e48b00-6a71-4713-b0a0-afc022be71ef tempest-AttachVolumeTestJSON-728167824 None] Deleting attachment 0ccb1254-02f3-4e9d-b02c-be160abbfc6b. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:47:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Acquiring lock "cinder-quobyte-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bab8c276-8ae0-4c20-85bd-b197770c8e9c tempest-GroupsV320Test-19756890 None] Group tempest-GroupsV320Test-Group-910938641: creating Sep 07 09:47:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Lock "cinder-quobyte-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4" acquired by "delete_volume" :: waited 0.047s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:10 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed917c-74fa-46b7-9450-ede5461e9dba]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bab8c276-8ae0-4c20-85bd-b197770c8e9c tempest-GroupsV320Test-19756890 None] Group tempest-GroupsV320Test-Group-910938641: created successfully Sep 07 09:47:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bab8c276-8ae0-4c20-85bd-b197770c8e9c tempest-GroupsV320Test-19756890 None] Create group completed successfully. Sep 07 09:47:10 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 Sep 07 09:47:10 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:11 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4" returned: 0 in 0.408s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:11 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4 Sep 07 09:47:11 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:11 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4" returned: 0 in 0.311s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Lock "cinder-quobyte-ec3c8810-d844-46f0-b0c9-21fb9a5ebdb4" released by "delete_volume" :: held 0.788s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:11 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Created reservations ['a5a3a118-4dbe-475c-8846-95ef5bd868a4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:11 devstack cinder-volume[87290]: WARNING cinder.quota [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1786452114 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1786452114, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:47:11 devstack cinder-volume[87290]: WARNING cinder.quota [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1786452114 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1786452114, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:47:11 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Created reservations ['d7d2e0cd-9711-4068-bcc7-4317e435ba8e', 'e60e418a-2800-4dd2-a85f-cea86b34bfa6', '31dd252d-508d-422d-90b7-bc2a224ff530', 'df5551f5-0607-4726-8057-32a6731500ce'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:12 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:12 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:12 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.502s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cb678255-053e-419d-8953-78c63245e7c3 tempest-GroupsTest-1534522660 None] Delete group completed successfully. Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Created reservations ['b37583be-6e99-4c18-ab04-79accacc62d4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:12 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:12 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Created reservations ['c2205696-1242-4d7b-a870-3dcad6ee01b9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:12 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:12 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:13 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.332s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:13 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c046b1e7-7ba3-447e-b3d6-bbb453e5eab0 tempest-GroupsV320Test-19756890 None] Delete group completed successfully. Sep 07 09:47:13 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.542s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:13 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3064ea19-9c6b-4e52-bf5c-8e1bd1a77211 tempest-GroupsTest-1534522660 None] Delete group completed successfully. Sep 07 09:47:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d2b60338-6659-4eda-8475-f3a82aa9209c tempest-GroupsTest-1534522660 None] Group tempest-GroupsTest-Group-2026982246: creating Sep 07 09:47:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d2b60338-6659-4eda-8475-f3a82aa9209c tempest-GroupsTest-1534522660 None] Group tempest-GroupsTest-Group-2026982246: created successfully Sep 07 09:47:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d2b60338-6659-4eda-8475-f3a82aa9209c tempest-GroupsTest-1534522660 None] Create group completed successfully. Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Flow 'volume_create_manager' (77905caf-3abe-4993-9cc4-f0739006a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af563701-2e42-47e4-b10c-c95a891347db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af563701-2e42-47e4-b10c-c95a891347db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959895645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a1e99a0-672e-4ab1-9c73-fbc308cef5df,host='devstack@QuobyteHD#QuobyteHD',id=1acaac55-fbae-408d-93df-d3aa5afa1878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85c81a5fd03484ba46a93f33219fdb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:16Z,use_quota=True,user_id='560a8f1be540437fa57f3a789ac84721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f052d2ba-de9a-4f4e-9f98-6942a12aa174),volume_type_id=f052d2ba-de9a-4f4e-9f98-6942a12aa174)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f166e-9bc1-495c-8ecf-5a9c0f973bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f166e-9bc1-495c-8ecf-5a9c0f973bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47286081-5463-4c9a-97f3-9fce5914a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47286081-5463-4c9a-97f3-9fce5914a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1acaac55-fbae-408d-93df-d3aa5afa1878', 'volume_name': 'volume-1acaac55-fbae-408d-93df-d3aa5afa1878', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fdf87e-2e99-4646-b1b0-6ce03c4b350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fdf87e-2e99-4646-b1b0-6ce03c4b350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c816093-5289-4127-a9cf-3235a9fef3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Volume 1acaac55-fbae-408d-93df-d3aa5afa1878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1acaac55-fbae-408d-93df-d3aa5afa1878', 'volume_size': 1} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6a1e99a0-672e-4ab1-9c73-fbc308cef5df,created_at=2026-09-07T07:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959895645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a1e99a0-672e-4ab1-9c73-fbc308cef5df,host='devstack@QuobyteHD#QuobyteHD',id=1acaac55-fbae-408d-93df-d3aa5afa1878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85c81a5fd03484ba46a93f33219fdb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:16Z,use_quota=True,user_id='560a8f1be540437fa57f3a789ac84721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f052d2ba-de9a-4f4e-9f98-6942a12aa174),volume_type_id=f052d2ba-de9a-4f4e-9f98-6942a12aa174)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Creating volume 1acaac55-fbae-408d-93df-d3aa5afa1878 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:47:16 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:47:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:16 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 1073741824 Sep 07 09:47:16 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:17 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "cinder-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 1073741824" returned: 0 in 0.665s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "cinder-quobyte-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:17 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 Sep 07 09:47:17 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-quobyte-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00" acquired by "delete_volume" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[06103e35-d2af-486a-ad4d-b67671ed6854]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:17 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 Sep 07 09:47:17 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:17 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878" returned: 0 in 0.303s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c816093-5289-4127-a9cf-3235a9fef3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1acaac55-fbae-408d-93df-d3aa5afa1878', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c332b4-530e-4c8c-9a05-d569fc6d4690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:17 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Volume volume-1acaac55-fbae-408d-93df-d3aa5afa1878 (1acaac55-fbae-408d-93df-d3aa5afa1878): created successfully Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c332b4-530e-4c8c-9a05-d569fc6d4690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Flow 'volume_create_manager' (77905caf-3abe-4993-9cc4-f0739006a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6356072c-18f0-4a74-bb26-3de61a4b6898 tempest-GroupsTest-1534522660 None] Created volume successfully. Sep 07 09:47:17 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00" returned: 0 in 0.396s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:17 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00 Sep 07 09:47:17 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:18 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00" returned: 0 in 0.248s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-quobyte-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00" released by "delete_volume" :: held 0.711s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Created reservations ['a64418ae-9105-4f0e-9e5f-e12f2bce878a', 'b1b20d43-172b-417e-9a42-711aebfbe83b', 'c76763fc-2996-4df0-a0f0-7b7f26ae56f0', '1307244a-ea79-4607-bd00-bff2d2a8e399'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:18 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:18 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "cinder-2f757b18-8cea-49c8-b922-08c89ff6bab4-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-2f757b18-8cea-49c8-b922-08c89ff6bab4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:18 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Deleted volume successfully. Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "cinder-quobyte-2f757b18-8cea-49c8-b922-08c89ff6bab4" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-65e09bbd-edbc-418c-9c98-2cca09a70db3 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-bbdd1b04-fcc2-4a5f-b7c5-519bc4f96a00-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-quobyte-2f757b18-8cea-49c8-b922-08c89ff6bab4" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01c103-fc84-4bed-8f48-64f1ce3f0804]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:18 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 Sep 07 09:47:18 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:19 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4" returned: 0 in 0.399s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:19 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4 Sep 07 09:47:19 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:19 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2f757b18-8cea-49c8-b922-08c89ff6bab4" returned: 0 in 0.264s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-quobyte-2f757b18-8cea-49c8-b922-08c89ff6bab4" released by "delete_volume" :: held 0.710s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Created reservations ['c2297951-3345-4620-ad1e-675a59b34391', 'dee32a2c-c3ec-4385-9ccc-512bf351e8fe', '5aa2f19c-e4bf-46bf-bada-7957296a1f6a', '68daf13f-4cbb-4b01-b194-1a8221bd71c9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:47:19 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:19 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Flow 'volume_create_manager' (392cf08e-2eda-44b1-9edf-7fc203ae186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaa8185-d25f-4300-a2a5-d638d6c7f1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaa8185-d25f-4300-a2a5-d638d6c7f1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686372527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a1e99a0-672e-4ab1-9c73-fbc308cef5df,host='devstack@QuobyteHD#QuobyteHD',id=fac6fcf4-5260-4ea4-98c0-c8388331fd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85c81a5fd03484ba46a93f33219fdb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:19Z,use_quota=True,user_id='560a8f1be540437fa57f3a789ac84721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f052d2ba-de9a-4f4e-9f98-6942a12aa174),volume_type_id=f052d2ba-de9a-4f4e-9f98-6942a12aa174)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30811d1d-1e76-40c5-9b5f-219d54e49605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30811d1d-1e76-40c5-9b5f-219d54e49605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c5a4c0-13bb-41e7-886d-6f50a95df425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c5a4c0-13bb-41e7-886d-6f50a95df425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac6fcf4-5260-4ea4-98c0-c8388331fd17', 'volume_name': 'volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23518a5-0431-49d4-9b2e-44ebdcdb2868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23518a5-0431-49d4-9b2e-44ebdcdb2868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f5c67a-70f8-4146-9237-ccd8d1d2d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:19 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Volume fac6fcf4-5260-4ea4-98c0-c8388331fd17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17', 'volume_size': 1} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6a1e99a0-672e-4ab1-9c73-fbc308cef5df,created_at=2026-09-07T07:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686372527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a1e99a0-672e-4ab1-9c73-fbc308cef5df,host='devstack@QuobyteHD#QuobyteHD',id=fac6fcf4-5260-4ea4-98c0-c8388331fd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85c81a5fd03484ba46a93f33219fdb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:19Z,use_quota=True,user_id='560a8f1be540437fa57f3a789ac84721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f052d2ba-de9a-4f4e-9f98-6942a12aa174),volume_type_id=f052d2ba-de9a-4f4e-9f98-6942a12aa174)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Creating volume fac6fcf4-5260-4ea4-98c0-c8388331fd17 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:47:19 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:19 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 1073741824 Sep 07 09:47:19 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:19 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.301s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:19 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Deleted volume successfully. Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "cinder-28fe2e5a-8f31-4003-b995-701371dec377-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d0620c5-8bd8-469e-a25c-e99acd4af4ff tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-2f757b18-8cea-49c8-b922-08c89ff6bab4-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-28fe2e5a-8f31-4003-b995-701371dec377-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "cinder-quobyte-28fe2e5a-8f31-4003-b995-701371dec377" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-quobyte-28fe2e5a-8f31-4003-b995-701371dec377" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6b862a-0a3d-49cc-83bb-418d6061048e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:20 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 Sep 07 09:47:20 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:20 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 1073741824" returned: 0 in 0.544s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:20 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 Sep 07 09:47:20 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:20 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377" returned: 0 in 0.410s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:20 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377 Sep 07 09:47:20 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:20 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17" returned: 0 in 0.306s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f5c67a-70f8-4146-9237-ccd8d1d2d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7129631a-4298-4a2a-abb1-414183085c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:20 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Volume volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 (fac6fcf4-5260-4ea4-98c0-c8388331fd17): created successfully Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7129631a-4298-4a2a-abb1-414183085c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Flow 'volume_create_manager' (392cf08e-2eda-44b1-9edf-7fc203ae186d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a20fedb1-045a-4310-bc15-3f4ecd080844 tempest-GroupsTest-1534522660 None] Created volume successfully. Sep 07 09:47:20 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-28fe2e5a-8f31-4003-b995-701371dec377" returned: 0 in 0.294s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-quobyte-28fe2e5a-8f31-4003-b995-701371dec377" released by "delete_volume" :: held 0.758s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Created reservations ['9fe75fb6-ddae-4309-9993-910ddaab8a4b', '3824dbb2-d92a-4209-b83f-44cbd52c317c', '3aa58ea1-d4ab-44d6-bebd-4606891f3b25', 'e8c478b4-a813-48ea-bddc-9de977747aa8'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:20 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:20 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:21 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.266s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:21 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Deleted volume successfully. Sep 07 09:47:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bd4360a-1cb5-4144-878c-67c07aea8e02 tempest-AttachVolumeTestJSON-728167824 None] Lock "cinder-28fe2e5a-8f31-4003-b995-701371dec377-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:22 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-724544b5-2dfc-407a-9c21-0b84ddc3a56b tempest-GroupsTest-1534522660 None] Update group completed successfully. Sep 07 09:47:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bd3e3839-aa48-4948-a51c-5588380048d0 tempest-GroupsTest-1534522660 None] Update group completed successfully. Sep 07 09:47:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Acquiring lock "cinder-quobyte-1acaac55-fbae-408d-93df-d3aa5afa1878" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Lock "cinder-quobyte-1acaac55-fbae-408d-93df-d3aa5afa1878" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed4237f-c8e1-4f38-b2ca-0a22f18b4944]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:25 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 Sep 07 09:47:25 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:26 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878" returned: 0 in 0.545s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:26 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878 Sep 07 09:47:26 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:26 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1acaac55-fbae-408d-93df-d3aa5afa1878" returned: 0 in 0.301s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Lock "cinder-quobyte-1acaac55-fbae-408d-93df-d3aa5afa1878" released by "delete_volume" :: held 0.923s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Acquiring lock "cinder-quobyte-fac6fcf4-5260-4ea4-98c0-c8388331fd17" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Lock "cinder-quobyte-fac6fcf4-5260-4ea4-98c0-c8388331fd17" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[38383ebc-960d-475a-9e1e-215f8aa0b6b3]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:26 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 Sep 07 09:47:26 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:27 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17" returned: 0 in 0.474s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:27 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17 Sep 07 09:47:27 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:27 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fac6fcf4-5260-4ea4-98c0-c8388331fd17" returned: 0 in 0.291s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Lock "cinder-quobyte-fac6fcf4-5260-4ea4-98c0-c8388331fd17" released by "delete_volume" :: held 0.844s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Created reservations ['b89399a1-b4d6-46e1-b9aa-45e1e7330067'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:27 devstack cinder-volume[87290]: WARNING cinder.quota [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1999362818 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1999362818, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:47:27 devstack cinder-volume[87290]: WARNING cinder.quota [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1999362818 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1999362818, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Created reservations ['bdb60758-94c2-478f-9478-9ba8b05b4110', '4a72b8aa-0411-43b3-96b4-69b55e27ea05', 'e12c3d14-4243-4a0b-8baa-c37ba1aa3475', '29d626d9-e07e-4312-9c54-ff2c65e8520f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Created reservations ['c2df97c6-b4e1-487e-a914-f5f74dd4a9cb', '09735f70-4994-45f9-9655-5b70bc3841fa', 'fc4ad6f7-8220-4a72-b722-b0d28fec6ba7', 'd776dc08-ee04-4e5c-b798-57b691d1c6af'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:27 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:27 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:27 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.255s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:27 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-900d3def-c062-4e08-8251-3e48da64e3a4 tempest-GroupsTest-1534522660 None] Delete group completed successfully. Sep 07 09:47:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-8ca4996a-369f-4993-9256-0cb7fb578468 req-9564bcd8-5084-465b-a85d-8670c9811afe tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-8ca4996a-369f-4993-9256-0cb7fb578468 req-9564bcd8-5084-465b-a85d-8670c9811afe tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-8ca4996a-369f-4993-9256-0cb7fb578468 req-9564bcd8-5084-465b-a85d-8670c9811afe tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-8ca4996a-369f-4993-9256-0cb7fb578468 req-9564bcd8-5084-465b-a85d-8670c9811afe tempest-ServerActionsTestOtherA-511722583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-4cc71185-971d-4019-9090-477700edf19b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5f26b38-a469-477f-8deb-a1e0c515ac9c', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:47:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-8ca4996a-369f-4993-9256-0cb7fb578468 req-9564bcd8-5084-465b-a85d-8670c9811afe tempest-ServerActionsTestOtherA-511722583 None] attachment_update completed successfully. Sep 07 09:47:34 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-d7d1590a-3b89-4250-9a43-364bab6b682c req-894eb40a-5371-449e-a49d-c5fb72462328 tempest-ServerActionsTestOtherA-511722583 None] Terminate volume connection completed successfully. Sep 07 09:47:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-d7d1590a-3b89-4250-9a43-364bab6b682c req-894eb40a-5371-449e-a49d-c5fb72462328 tempest-ServerActionsTestOtherA-511722583 None] Deleting attachment e5f26b38-a469-477f-8deb-a1e0c515ac9c. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:47:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d7d1590a-3b89-4250-9a43-364bab6b682c req-3b8ff4de-364e-4932-9585-008d775e241c tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d7d1590a-3b89-4250-9a43-364bab6b682c req-3b8ff4de-364e-4932-9585-008d775e241c tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d7d1590a-3b89-4250-9a43-364bab6b682c req-3b8ff4de-364e-4932-9585-008d775e241c tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-d7d1590a-3b89-4250-9a43-364bab6b682c req-3b8ff4de-364e-4932-9585-008d775e241c tempest-ServerActionsTestOtherA-511722583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-4cc71185-971d-4019-9090-477700edf19b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6eb2a87b-c668-4ca1-9f2b-d6468bd877d9', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:47:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-d7d1590a-3b89-4250-9a43-364bab6b682c req-3b8ff4de-364e-4932-9585-008d775e241c tempest-ServerActionsTestOtherA-511722583 None] attachment_update completed successfully. Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=139,cinder:INSERT=30,cinder:UPDATE=141,cinder:DELETE=5 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=139,cinder:SELECT=140,cinder:DELETE=9,cinder:INSERT=27 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Flow 'volume_create_manager' (80ec5c09-b3e8-4ade-bba2-39dc37c76c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6e697c-4a5b-427e-b40c-0cf6c347c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6e697c-4a5b-427e-b40c-0cf6c347c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1240725953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a5b182-44f9-4ceb-8b3b-0c28c15a97e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505b2262c8d94ea4854f03d96bfd9502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:38Z,use_quota=True,user_id='57bedb31d6a14d6f828be71fd554a50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92930a7-8064-4ea8-bcf4-a6fa0ae2533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92930a7-8064-4ea8-bcf4-a6fa0ae2533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea8332d-dba6-4a62-9f1c-ab3b4dc186f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea8332d-dba6-4a62-9f1c-ab3b4dc186f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a5b182-44f9-4ceb-8b3b-0c28c15a97e6', 'volume_name': 'volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463b4420-b4ea-4804-a00d-77f3d4c6e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463b4420-b4ea-4804-a00d-77f3d4c6e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be564b76-51b0-498d-ad8d-d684321457e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:38 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6', 'volume_size': 1} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1240725953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a5b182-44f9-4ceb-8b3b-0c28c15a97e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505b2262c8d94ea4854f03d96bfd9502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:38Z,use_quota=True,user_id='57bedb31d6a14d6f828be71fd554a50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Creating volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:47:38 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:47:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:38 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 1073741824 Sep 07 09:47:38 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:39 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 1073741824" returned: 0 in 0.810s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:39 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 Sep 07 09:47:39 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:39 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" returned: 0 in 0.333s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be564b76-51b0-498d-ad8d-d684321457e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62485805-0bba-4b45-9cc6-b021386a4476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Volume volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 (21a5b182-44f9-4ceb-8b3b-0c28c15a97e6): created successfully Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62485805-0bba-4b45-9cc6-b021386a4476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Flow 'volume_create_manager' (80ec5c09-b3e8-4ade-bba2-39dc37c76c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3624ed31-42f3-4c9a-8606-039ad7929e76 tempest-SnapshotsActionsTest-121833105 None] Created volume successfully. Sep 07 09:47:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Creating offline snapshot abca09fc-dfd6-4847-a2c9-7e4a15668c5c of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:47:40 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc940964-6db0-42a2-b1db-8ed4afba6b56]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:41 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 Sep 07 09:47:41 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:41 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:41 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:41 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.400s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 8 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:47:41 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" returned: 0 in 0.671s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:41 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c 1G Sep 07 09:47:41 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:42 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c 1G" returned: 0 in 0.812s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:42 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:47:42 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:42 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.460s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:42 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c is being set with open permissions: ugo+rw Sep 07 09:47:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:42 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:47:42 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:43 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:43 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.info Sep 07 09:47:43 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:43 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.info" returned: 0 in 0.468s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:43 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.info is being set with open permissions: ugo+rw Sep 07 09:47:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:43 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.info Sep 07 09:47:43 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Flow 'volume_create_manager' (26c9f315-6930-4d9e-81aa-3dd8a44f383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:44 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b609733-6cb5-44f1-88eb-023e48d31908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.info" returned: 0 in 0.458s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.454s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b609733-6cb5-44f1-88eb-023e48d31908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-348377817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56832b-539f-44d8-9d85-2b46777b84f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80c866cea914f2b948f129e6cd398c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:44Z,use_quota=True,user_id='b6a33cb8440543459be5891b5bb4035d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da522008-b562-4219-93aa-cd8998609726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da522008-b562-4219-93aa-cd8998609726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70147658-c04b-4204-b820-b34ce4271be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70147658-c04b-4204-b820-b34ce4271be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e56832b-539f-44d8-9d85-2b46777b84f9', 'volume_name': 'volume-2e56832b-539f-44d8-9d85-2b46777b84f9', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6130d888-b4da-4309-84bc-0fff7cb4e52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6130d888-b4da-4309-84bc-0fff7cb4e52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfaaee5-17ab-4cd8-8c5a-132bbd304d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:44 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Volume 2e56832b-539f-44d8-9d85-2b46777b84f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e56832b-539f-44d8-9d85-2b46777b84f9', 'volume_size': 1} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-348377817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56832b-539f-44d8-9d85-2b46777b84f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80c866cea914f2b948f129e6cd398c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:44Z,use_quota=True,user_id='b6a33cb8440543459be5891b5bb4035d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Creating volume 2e56832b-539f-44d8-9d85-2b46777b84f9 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:47:44 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:47:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:44 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 1073741824 Sep 07 09:47:44 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c356beae-7b72-4eb6-bfa3-00c314c1dd4b tempest-SnapshotsActionsTest-121833105 None] Create snapshot completed successfully Sep 07 09:47:45 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 1073741824" returned: 0 in 0.783s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:45 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 Sep 07 09:47:45 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:45 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfaaee5-17ab-4cd8-8c5a-132bbd304d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e56832b-539f-44d8-9d85-2b46777b84f9', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bc4c14-a82e-4bf7-b645-931b401bf4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:45 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Volume volume-2e56832b-539f-44d8-9d85-2b46777b84f9 (2e56832b-539f-44d8-9d85-2b46777b84f9): created successfully Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bc4c14-a82e-4bf7-b645-931b401bf4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Flow 'volume_create_manager' (26c9f315-6930-4d9e-81aa-3dd8a44f383b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7cce9f88-1225-4bb8-9db6-976da8a34600 tempest-VolumeQuotasAdminTestJSON-41651692 None] Created volume successfully. Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Creating offline snapshot 4eb3bf85-5598-444c-b7fb-af4e09a7f36c of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[960a20f6-de2b-487a-b3a0-a5539e554063]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:46 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:47:46 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:46 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.523s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:46 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c 1G Sep 07 09:47:46 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Acquiring lock "cinder-2e56832b-539f-44d8-9d85-2b46777b84f9-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "cinder-2e56832b-539f-44d8-9d85-2b46777b84f9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Acquiring lock "cinder-quobyte-2e56832b-539f-44d8-9d85-2b46777b84f9" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "cinder-quobyte-2e56832b-539f-44d8-9d85-2b46777b84f9" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f56f26-7fbd-41e4-90c1-16c5e854ee5e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:46 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 Sep 07 09:47:46 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:47 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9" returned: 0 in 0.603s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:47 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c 1G" returned: 0 in 0.915s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:47 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9 Sep 07 09:47:47 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:47 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c Sep 07 09:47:47 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:47 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2e56832b-539f-44d8-9d85-2b46777b84f9" returned: 0 in 0.313s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "cinder-quobyte-2e56832b-539f-44d8-9d85-2b46777b84f9" released by "delete_volume" :: held 0.980s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Created reservations ['b0371057-0323-493a-8f2a-32a9e53104ec', 'f1e3a48f-3228-4125-80f6-c4231568350e', '3b2a7642-a462-49cf-870f-9d53e6b57513', '5b805e49-0d85-497d-a45a-f3cd35f1ebe1'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:47 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c" returned: 0 in 0.498s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:47 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c is being set with open permissions: ugo+rw Sep 07 09:47:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:47 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:47 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:47 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c Sep 07 09:47:47 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:48 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.329s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:48 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Deleted volume successfully. Sep 07 09:47:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e68fb66d-1109-49b0-9a89-928e0b3143bf tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "cinder-2e56832b-539f-44d8-9d85-2b46777b84f9-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:48 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c" returned: 0 in 0.375s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4e9b3d5f-7ac5-45c1-b330-8dfbacf9abb8 tempest-SnapshotsActionsTest-121833105 None] Create snapshot completed successfully Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-4eb3bf85-5598-444c-b7fb-af4e09a7f36c-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-4eb3bf85-5598-444c-b7fb-af4e09a7f36c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-4eb3bf85-5598-444c-b7fb-af4e09a7f36c" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-4eb3bf85-5598-444c-b7fb-af4e09a7f36c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Deleting offline snapshot 4eb3bf85-5598-444c-b7fb-af4e09a7f36c of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] snapshot_file for this snap is: volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[67354a01-224b-47c5-9367-3ae099a079bb]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Flow 'volume_create_manager' (ba836919-9fb5-4c8a-afd4-bada12975999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:49 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c Sep 07 09:47:49 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63e5643-5cf3-48c1-afad-31876371a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63e5643-5cf3-48c1-afad-31876371a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-617887864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0edbb5-e655-463d-81ca-fe14da97a117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80c866cea914f2b948f129e6cd398c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:49Z,use_quota=True,user_id='b6a33cb8440543459be5891b5bb4035d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbff8059-5b4e-4356-875e-af56ea5cecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbff8059-5b4e-4356-875e-af56ea5cecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a14e977-6daa-43a9-a414-73c8c82396d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a14e977-6daa-43a9-a414-73c8c82396d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0edbb5-e655-463d-81ca-fe14da97a117', 'volume_name': 'volume-6e0edbb5-e655-463d-81ca-fe14da97a117', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eabf7c5-848d-40ca-ad6d-b9d9a61bc26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eabf7c5-848d-40ca-ad6d-b9d9a61bc26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0caffddf-0d45-4bd1-bdd0-712918fa3949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:49 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Volume 6e0edbb5-e655-463d-81ca-fe14da97a117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0edbb5-e655-463d-81ca-fe14da97a117', 'volume_size': 1} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-617887864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0edbb5-e655-463d-81ca-fe14da97a117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80c866cea914f2b948f129e6cd398c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:47:49Z,use_quota=True,user_id='b6a33cb8440543459be5891b5bb4035d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Creating volume 6e0edbb5-e655-463d-81ca-fe14da97a117 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:47:49 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:49 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 1073741824 Sep 07 09:47:49 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:49 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c" returned: 0 in 0.467s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db301af-145b-420a-bbfa-ac362c3d165d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:50 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:47:50 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:50 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 1073741824" returned: 0 in 0.538s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:50 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 Sep 07 09:47:50 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:50 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.478s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:50 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c Sep 07 09:47:50 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:50 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117" returned: 0 in 0.448s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0caffddf-0d45-4bd1-bdd0-712918fa3949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0edbb5-e655-463d-81ca-fe14da97a117', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f475c7e-c6b6-447e-9876-f57eacf5dada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:47:50 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Volume volume-6e0edbb5-e655-463d-81ca-fe14da97a117 (6e0edbb5-e655-463d-81ca-fe14da97a117): created successfully Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f475c7e-c6b6-447e-9876-f57eacf5dada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Flow 'volume_create_manager' (ba836919-9fb5-4c8a-afd4-bada12975999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:47:50 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8348121e-14fe-4568-a2c3-13c7cf04c9eb tempest-VolumeQuotasAdminTestJSON-41651692 None] Created volume successfully. Sep 07 09:47:50 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c" returned: 0 in 0.528s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:50 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c Sep 07 09:47:50 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:51 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.4eb3bf85-5598-444c-b7fb-af4e09a7f36c" returned: 0 in 0.285s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:51 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-4eb3bf85-5598-444c-b7fb-af4e09a7f36c" released by "_delete_snapshot" :: held 1.899s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:51 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" released by "delete_snapshot" :: held 1.930s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:51 devstack cinder-volume[87290]: WARNING cinder.quota [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:47:51 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Created reservations ['1c9719e0-2fe6-45ab-9cbb-5141c82dbad9', '79f8ec2f-50cd-4b5e-bdb5-c0c0df285282', '3669e544-5ed0-41c9-8780-e087972ba232', '3bc4ac69-1b2a-40c0-9055-407e5a50d9a2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Delete snapshot completed successfully. Sep 07 09:47:51 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0efe15eb-38ae-4bf0-824c-647dc42ab58e tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-4eb3bf85-5598-444c-b7fb-af4e09a7f36c-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Creating offline snapshot f5410b76-b0ea-4513-8f35-a0cf081e0a2a of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:47:52 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f8d10-0b34-4eb5-891e-34df709a0bf2]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:52 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:47:52 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:52 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.596s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:47:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:52 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a 1G Sep 07 09:47:52 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:53 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-308e88a6-e0c2-40fd-8bec-c98075296654 tempest-VolumeQuotasAdminTestJSON-1122885906 None] Transfer volume completed successfully. Sep 07 09:47:53 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a 1G" returned: 0 in 0.980s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:53 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a Sep 07 09:47:53 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Acquiring lock "cinder-6e0edbb5-e655-463d-81ca-fe14da97a117-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Lock "cinder-6e0edbb5-e655-463d-81ca-fe14da97a117-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Acquiring lock "cinder-quobyte-6e0edbb5-e655-463d-81ca-fe14da97a117" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Lock "cinder-quobyte-6e0edbb5-e655-463d-81ca-fe14da97a117" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bbca10-7baf-43c4-aea6-79954459d5dc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:54 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a" returned: 0 in 0.355s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:54 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a is being set with open permissions: ugo+rw Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:54 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a Sep 07 09:47:54 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:54 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 Sep 07 09:47:54 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:54 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a" returned: 0 in 0.294s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:54 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0d445d1e-c814-4d48-bc48-cdc471b1c902 tempest-SnapshotsActionsTest-121833105 None] Create snapshot completed successfully Sep 07 09:47:54 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117" returned: 0 in 0.408s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:54 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117 Sep 07 09:47:54 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:54 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6e0edbb5-e655-463d-81ca-fe14da97a117" returned: 0 in 0.276s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Lock "cinder-quobyte-6e0edbb5-e655-463d-81ca-fe14da97a117" released by "delete_volume" :: held 0.729s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Created reservations ['cfc9a7ec-fb61-4e45-8ba2-181f40f0fba7', '77d04944-8288-43a1-a3f0-453c54e60692', 'e64a8da0-320e-442a-9427-f5d607a20f84', 'dded3681-bc4a-4440-a8c9-aba9b6071b5a'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:47:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:54 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:47:54 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:55 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.255s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:47:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Deleted volume successfully. Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-600e226d-16d1-43e5-963e-880d1ba2134f tempest-VolumeQuotasAdminTestJSON-992472597 None] Lock "cinder-6e0edbb5-e655-463d-81ca-fe14da97a117-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-f5410b76-b0ea-4513-8f35-a0cf081e0a2a-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-f5410b76-b0ea-4513-8f35-a0cf081e0a2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-f5410b76-b0ea-4513-8f35-a0cf081e0a2a" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-f5410b76-b0ea-4513-8f35-a0cf081e0a2a" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Deleting offline snapshot f5410b76-b0ea-4513-8f35-a0cf081e0a2a of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] snapshot_file for this snap is: volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb8abb5-8f67-4a76-ad1f-e7d88f16d91d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:55 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a Sep 07 09:47:55 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:56 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a" returned: 0 in 0.858s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:47:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca7f80c-6021-488d-aad0-30fd5d311838]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:56 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:47:56 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:57 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.607s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:47:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:57 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a Sep 07 09:47:57 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:57 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a" returned: 0 in 0.547s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:57 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a Sep 07 09:47:57 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:57 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.f5410b76-b0ea-4513-8f35-a0cf081e0a2a" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-f5410b76-b0ea-4513-8f35-a0cf081e0a2a" released by "_delete_snapshot" :: held 2.538s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" released by "delete_snapshot" :: held 2.622s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:58 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Created reservations ['17d1d167-7d3d-4555-822e-6f512b5b590f', 'f6df0236-3368-4586-ae2e-0b0178e2f6b6', 'cd64d05e-ed83-4e68-b98a-6f5eeaec9f27', '64dbf0fb-e525-40dc-b427-7f7160a3d40f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:47:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Delete snapshot completed successfully. Sep 07 09:47:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a4add041-6e79-4e1b-9ff9-f32d4005a796 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-f5410b76-b0ea-4513-8f35-a0cf081e0a2a-delete_snapshot" released by "delete_snapshot" :: held 2.847s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Creating offline snapshot 23f8772a-3831-4129-a33d-2e2d94a3938a of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aae0ce-b946-48b4-a20e-ac600825ef36]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:59 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:47:59 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:47:59 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.604s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:47:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:47:59 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a 1G Sep 07 09:47:59 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:00 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a 1G" returned: 0 in 0.794s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:00 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a Sep 07 09:48:00 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:01 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a" returned: 0 in 0.614s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:01 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a is being set with open permissions: ugo+rw Sep 07 09:48:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:01 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a Sep 07 09:48:01 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:01 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a" returned: 0 in 0.328s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:01 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-247926f3-a419-44b5-92be-0b6cd3b85fa1 tempest-SnapshotsActionsTest-121833105 None] Create snapshot completed successfully Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-23f8772a-3831-4129-a33d-2e2d94a3938a-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-23f8772a-3831-4129-a33d-2e2d94a3938a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-23f8772a-3831-4129-a33d-2e2d94a3938a" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-23f8772a-3831-4129-a33d-2e2d94a3938a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Deleting offline snapshot 23f8772a-3831-4129-a33d-2e2d94a3938a of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] snapshot_file for this snap is: volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b50142e-7b0d-40dd-bde8-ecbf3a4e63d1]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:02 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a Sep 07 09:48:02 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:03 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a" returned: 0 in 0.643s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:48:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f0457-1cb4-401e-ad76-7cb45664a772]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:03 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:48:03 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:03 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.563s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:48:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:03 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a Sep 07 09:48:03 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-780264bd-8197-4173-a9eb-125f880ee05e req-c9120dcf-2e8d-40d7-86cd-8e49716acbd5 tempest-ServerActionsTestOtherA-511722583 None] Terminate volume connection completed successfully. Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-780264bd-8197-4173-a9eb-125f880ee05e req-c9120dcf-2e8d-40d7-86cd-8e49716acbd5 tempest-ServerActionsTestOtherA-511722583 None] Deleting attachment 6eb2a87b-c668-4ca1-9f2b-d6468bd877d9. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:48:04 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a" returned: 0 in 0.570s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:04 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a Sep 07 09:48:04 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:04 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.23f8772a-3831-4129-a33d-2e2d94a3938a" returned: 0 in 0.308s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-23f8772a-3831-4129-a33d-2e2d94a3938a" released by "_delete_snapshot" :: held 2.243s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" released by "delete_snapshot" :: held 2.289s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Created reservations ['cc3648ff-e024-4c7f-ac39-49bcf92f6a1f', '2163fc3d-a381-4dd2-9f7f-c3b3d197628f', '24487b73-1d46-4262-8a9b-014d616c85ee', 'bce77c76-f691-4bff-8ac1-230f95828b5a'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Delete snapshot completed successfully. Sep 07 09:48:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-802dc14a-0b6e-437e-96c6-74f04961f6e6 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-23f8772a-3831-4129-a33d-2e2d94a3938a-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Creating offline snapshot e9fa4f9d-c78e-4baf-9d39-ab636778bc1c of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:48:06 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfdab08-c040-4db9-82be-946832f23688]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:06 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:48:06 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:07 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.722s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:48:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:07 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c 1G Sep 07 09:48:07 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:07 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c 1G" returned: 0 in 0.590s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:07 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c Sep 07 09:48:07 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:08 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" returned: 0 in 0.482s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:08 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c is being set with open permissions: ugo+rw Sep 07 09:48:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:08 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c Sep 07 09:48:08 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:08 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bd71393f-c190-4599-86cf-8e469b0f70a1 tempest-SnapshotsActionsTest-121833105 None] Create snapshot completed successfully Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-e9fa4f9d-c78e-4baf-9d39-ab636778bc1c-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-e9fa4f9d-c78e-4baf-9d39-ab636778bc1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Acquiring lock "cinder-quobyte-e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Deleting offline snapshot e9fa4f9d-c78e-4baf-9d39-ab636778bc1c of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] snapshot_file for this snap is: volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cebd414-4a37-4f32-8788-338459ea15dc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:10 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c Sep 07 09:48:10 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:10 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:48:10 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[015d349d-6853-4370-8675-19675150fc26]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:10 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:48:10 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:10 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.447s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:48:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:10 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c Sep 07 09:48:10 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:11 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" returned: 0 in 0.469s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:11 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c Sep 07 09:48:11 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:11 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" returned: 0 in 0.303s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-e9fa4f9d-c78e-4baf-9d39-ab636778bc1c" released by "_delete_snapshot" :: held 1.813s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" released by "delete_snapshot" :: held 1.862s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:11 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Created reservations ['6a8f57cb-65ea-45e1-bb7b-1bdfe8780c94', 'cf651e50-7963-42bd-b2dd-611a8e6fa253', 'c1a083d2-e2b7-4c7d-812e-91c4263b069d', 'bd1e8ef3-78f6-4dc7-ae2a-f631324dbccf'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Delete snapshot completed successfully. Sep 07 09:48:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d44970bc-f122-4815-aa42-ab35441279e1 tempest-SnapshotsActionsTest-568930522 None] Lock "cinder-e9fa4f9d-c78e-4baf-9d39-ab636778bc1c-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Flow 'volume_create_manager' (1099c05a-7faf-449e-a447-0bc0a6cbff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38feaae8-98a9-4c5e-9b45-014332ef0675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38feaae8-98a9-4c5e-9b45-014332ef0675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1473807024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56becc42-15b9-4dc0-991d-0445c52577a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e515c38335b4f5baa626ea1eceb641d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:12Z,use_quota=True,user_id='c0d0f2d97e254e0480b7b32c24d4a712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c7a755-5e09-40cf-8d34-dbeb9f9b9dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c7a755-5e09-40cf-8d34-dbeb9f9b9dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87e9385-aa92-47f2-a0c0-dd7faac62b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "cinder-abca09fc-dfd6-4847-a2c9-7e4a15668c5c-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-abca09fc-dfd6-4847-a2c9-7e4a15668c5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "cinder-quobyte-abca09fc-dfd6-4847-a2c9-7e4a15668c5c" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-quobyte-abca09fc-dfd6-4847-a2c9-7e4a15668c5c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Deleting offline snapshot abca09fc-dfd6-4847-a2c9-7e4a15668c5c of volume 21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] snapshot_file for this snap is: volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d02e5-7720-4d63-8301-d7b64c7760ab]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:12 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:48:12 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:12 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.400s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52b3d1a-c76f-41ef-ab52-2c403757af6f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:13 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 Sep 07 09:48:13 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87e9385-aa92-47f2-a0c0-dd7faac62b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56becc42-15b9-4dc0-991d-0445c52577a0', 'volume_name': 'volume-56becc42-15b9-4dc0-991d-0445c52577a0', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df68b08-c678-4877-a1d4-f72c81c79cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df68b08-c678-4877-a1d4-f72c81c79cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d592dbb3-66d5-4d36-9a22-9249568d2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Volume 56becc42-15b9-4dc0-991d-0445c52577a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56becc42-15b9-4dc0-991d-0445c52577a0', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Trying to clone 56becc42-15b9-4dc0-991d-0445c52577a0 from image 262465d0-5b79-4e49-bcf9-a496a478d70a at location (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 09:48:13 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" returned: 0 in 0.418s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:13 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:48:13 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 09:48:13 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Image download 20.69 MB at 20.69 MB/s Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a247c0d4-6a37-4a8b-81eb-a63bb546b303]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:13 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.444s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:13 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD Sep 07 09:48:13 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:13 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c Sep 07 09:48:13 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:14 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a is fetched for user c0d0f2d97e254e0480b7b32c24d4a712. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 09:48:14 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6.abca09fc-dfd6-4847-a2c9-7e4a15668c5c" returned: 0 in 0.295s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-quobyte-abca09fc-dfd6-4847-a2c9-7e4a15668c5c" released by "_delete_snapshot" :: held 1.679s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[57365c42-8a90-44c0-a886-6b49c4859f24]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" released by "delete_snapshot" :: held 1.716s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Created reservations ['d255e3f0-63a9-4461-b1af-67ec4907e1c1', 'ec916c50-abfb-47d3-bea0-e4a803d705d5', '0db0c00b-f2f1-43c7-a8e1-0b27ce2e9b07', '155b14fb-0723-4c68-8365-cf82685aedf8'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:14 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD Sep 07 09:48:14 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Delete snapshot completed successfully. Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ab36105-e0f0-4c2a-884a-5384c63d5dbd tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-abca09fc-dfd6-4847-a2c9-7e4a15668c5c-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:14 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1473807024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56becc42-15b9-4dc0-991d-0445c52577a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e515c38335b4f5baa626ea1eceb641d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:12Z,use_quota=True,user_id='c0d0f2d97e254e0480b7b32c24d4a712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Creating volume 56becc42-15b9-4dc0-991d-0445c52577a0 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:14 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:14 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 1073741824 Sep 07 09:48:14 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "cinder-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c27d9d-200a-42f7-a399-4c2c2cc310db]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:15 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 Sep 07 09:48:15 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:15 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 1073741824" returned: 0 in 0.466s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:15 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 Sep 07 09:48:15 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:15 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" returned: 0 in 0.376s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:15 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6 Sep 07 09:48:15 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:15 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Attempting download of 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 56becc42-15b9-4dc0-991d-0445c52577a0. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d70868d-1813-4959-ab41-1b8a0e7c83e0]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_k50fzm0f {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:15 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" returned: 0 in 0.324s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-quobyte-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6" released by "delete_volume" :: held 0.772s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Created reservations ['2695018b-f97e-445f-b182-49581a33198c', '5113ae7b-e782-43e6-a38a-cff1dcb4db46', 'df863e6e-1268-4634-bbf7-5250044d0a13', 'ce5bed8b-3f75-4488-aadd-c55493825898'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:15 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_k50fzm0f Sep 07 09:48:15 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Flow 'volume_create_manager' (550a60b3-885c-47ed-be86-329215eaf972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52bbbb-90ed-4822-a868-046c162682be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52bbbb-90ed-4822-a868-046c162682be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-582043745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ab09d4-bc7d-4bc7-b184-714e84d48b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893a584a9a340d0bd1ab284414ce870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:16Z,use_quota=True,user_id='e463b314a44e45d8868c5ea57979f388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02565a3-03be-406c-b3be-f3a70cebc15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02565a3-03be-406c-b3be-f3a70cebc15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e53e9a-9f77-4d14-8b1b-7b8c0a52f4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e53e9a-9f77-4d14-8b1b-7b8c0a52f4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ab09d4-bc7d-4bc7-b184-714e84d48b30', 'volume_name': 'volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8484653f-4a18-4339-8a2b-48e27392fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8484653f-4a18-4339-8a2b-48e27392fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81636ce5-dd93-400f-b4c3-93576acd6676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:15 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Volume 37ab09d4-bc7d-4bc7-b184-714e84d48b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30', 'volume_size': 1} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-582043745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ab09d4-bc7d-4bc7-b184-714e84d48b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893a584a9a340d0bd1ab284414ce870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:16Z,use_quota=True,user_id='e463b314a44e45d8868c5ea57979f388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Creating volume 37ab09d4-bc7d-4bc7-b184-714e84d48b30 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:15 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:15 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 1073741824 Sep 07 09:48:15 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:15 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:48:15 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:15 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_k50fzm0f" returned: 0 in 0.399s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_k50fzm0f {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:16 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_k50fzm0f Sep 07 09:48:16 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:16 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.325s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:48:16 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Deleted volume successfully. Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59f08f32-0cfe-4af0-9d17-375c65117dd9 tempest-SnapshotsActionsTest-121833105 None] Lock "cinder-21a5b182-44f9-4ceb-8b3b-0c28c15a97e6-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:16 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_k50fzm0f" returned: 1 in 0.382s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_k50fzm0f' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d891fc6-5e26-4211-98e6-912763c4a933]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:16 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 1073741824" returned: 0 in 0.559s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:16 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD Sep 07 09:48:16 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:16 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 Sep 07 09:48:16 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:16 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] 262465d0-5b79-4e49-bcf9-a496a478d70a was qcow2, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:16 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30" returned: 0 in 0.304s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:16 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 Sep 07 09:48:16 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81636ce5-dd93-400f-b4c3-93576acd6676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86aff61-3676-43b7-bcec-f0717c23cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Volume volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 (37ab09d4-bc7d-4bc7-b184-714e84d48b30): created successfully Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86aff61-3676-43b7-bcec-f0717c23cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Flow 'volume_create_manager' (550a60b3-885c-47ed-be86-329215eaf972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:16 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8cdb7004-b527-4ba4-97e4-393a998865be tempest-VolumesListAdminTestJSON-1266064874 None] Created volume successfully. Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Flow 'volume_create_manager' (79874b0b-5070-4120-93f5-f4cbaa9172dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b74bce0-6194-44a3-804e-d6f1cdc74530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b74bce0-6194-44a3-804e-d6f1cdc74530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705038626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0842fc3-75ad-44d7-9aed-74e5b107f899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893a584a9a340d0bd1ab284414ce870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:19Z,use_quota=True,user_id='e463b314a44e45d8868c5ea57979f388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b55c99-1194-4a7b-92b9-6b131a07bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b55c99-1194-4a7b-92b9-6b131a07bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7891e137-70af-4b87-ad81-b3eb778db539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7891e137-70af-4b87-ad81-b3eb778db539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0842fc3-75ad-44d7-9aed-74e5b107f899', 'volume_name': 'volume-e0842fc3-75ad-44d7-9aed-74e5b107f899', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7595ea45-51e9-4724-aa29-0b353efb8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7595ea45-51e9-4724-aa29-0b353efb8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c83e0a-6038-4b97-bfa1-0f77b8f65583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:18 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Volume e0842fc3-75ad-44d7-9aed-74e5b107f899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0842fc3-75ad-44d7-9aed-74e5b107f899', 'volume_size': 1} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705038626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0842fc3-75ad-44d7-9aed-74e5b107f899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893a584a9a340d0bd1ab284414ce870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:19Z,use_quota=True,user_id='e463b314a44e45d8868c5ea57979f388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Creating volume e0842fc3-75ad-44d7-9aed-74e5b107f899 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:18 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:18 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 1073741824 Sep 07 09:48:18 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:19 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0" returned: 0 in 2.369s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_22vdgpu4devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:48:19 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Converted 112.00 MB image at 47.24 MB/s Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:19 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 1G Sep 07 09:48:19 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:19 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 1073741824" returned: 0 in 0.526s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:19 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 Sep 07 09:48:19 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:19 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 1G" returned: 0 in 0.491s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Downloaded image 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 56becc42-15b9-4dc0-991d-0445c52577a0 successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a for user c0d0f2d97e254e0480b7b32c24d4a712 is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Marking volume 56becc42-15b9-4dc0-991d-0445c52577a0 as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Copying metadata from image 262465d0-5b79-4e49-bcf9-a496a478d70a to 56becc42-15b9-4dc0-991d-0445c52577a0. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Creating volume glance metadata for volume 56becc42-15b9-4dc0-991d-0445c52577a0 backed by image 262465d0-5b79-4e49-bcf9-a496a478d70a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 09:48:19 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899" returned: 0 in 0.365s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d592dbb3-66d5-4d36-9a22-9249568d2629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56becc42-15b9-4dc0-991d-0445c52577a0', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48b6a94-9a8c-4f9f-a431-6801b1598644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c83e0a-6038-4b97-bfa1-0f77b8f65583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0842fc3-75ad-44d7-9aed-74e5b107f899', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82db2e66-2005-418d-b58b-87f9e635d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:19 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Volume volume-56becc42-15b9-4dc0-991d-0445c52577a0 (56becc42-15b9-4dc0-991d-0445c52577a0): created successfully Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48b6a94-9a8c-4f9f-a431-6801b1598644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Flow 'volume_create_manager' (1099c05a-7faf-449e-a447-0bc0a6cbff8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:19 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Volume volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 (e0842fc3-75ad-44d7-9aed-74e5b107f899): created successfully Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82db2e66-2005-418d-b58b-87f9e635d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Flow 'volume_create_manager' (79874b0b-5070-4120-93f5-f4cbaa9172dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:19 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-910768df-8965-46e0-b0be-edf34064ce8d tempest-ServerActionsTestOtherA-511722583 None] Created volume successfully. Sep 07 09:48:19 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a1c32a67-79f1-47c1-b27b-0a8fbfc1d763 tempest-VolumesListAdminTestJSON-1266064874 None] Created volume successfully. Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Flow 'volume_create_manager' (4e0bdaa1-271a-4670-a743-ccd8120f00f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed72fa7b-5b73-4a73-854f-4238c45254e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed72fa7b-5b73-4a73-854f-4238c45254e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-509258813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6934e5-13aa-48ac-802c-38cb0d7ba9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893a584a9a340d0bd1ab284414ce870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:21Z,use_quota=True,user_id='e463b314a44e45d8868c5ea57979f388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbda5da-11a6-4211-a45c-b6ed864e8adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbda5da-11a6-4211-a45c-b6ed864e8adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c8e769-a9c7-4dbd-a283-5c1f9c3188f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c8e769-a9c7-4dbd-a283-5c1f9c3188f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6934e5-13aa-48ac-802c-38cb0d7ba9a0', 'volume_name': 'volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e189d20-c0ed-4cd9-9b43-a19461aebb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e189d20-c0ed-4cd9-9b43-a19461aebb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a132c376-f447-4591-b70f-2687bba09a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Volume dc6934e5-13aa-48ac-802c-38cb0d7ba9a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0', 'volume_size': 1} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-509258813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6934e5-13aa-48ac-802c-38cb0d7ba9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893a584a9a340d0bd1ab284414ce870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:21Z,use_quota=True,user_id='e463b314a44e45d8868c5ea57979f388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Creating volume dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:21 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:21 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 1073741824 Sep 07 09:48:21 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Flow 'volume_create_manager' (be4e00d6-be19-47af-b6a2-1be1c0b3bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48df33ee-e600-4246-ba14-c2ad5c11a9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48df33ee-e600-4246-ba14-c2ad5c11a9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-240560912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0581b747-b7a0-40cd-83c7-f1fe15c5fa11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577d7d1f8bf4b32a569094a58165f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:22Z,use_quota=True,user_id='c11d4c72d9e24bee9936597109683264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23de0dc2-787a-4c8a-96c4-666eb3ce6475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23de0dc2-787a-4c8a-96c4-666eb3ce6475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af74aba-a0ff-4622-b2da-5fde1a5c2687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af74aba-a0ff-4622-b2da-5fde1a5c2687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0581b747-b7a0-40cd-83c7-f1fe15c5fa11', 'volume_name': 'volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1eea11-22d1-4915-8dc2-79c50d8876e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1eea11-22d1-4915-8dc2-79c50d8876e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831b9fff-b6a0-4c0a-8d93-719ae7ab7a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Volume 0581b747-b7a0-40cd-83c7-f1fe15c5fa11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11', 'volume_size': 1} Sep 07 09:48:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:22 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 1073741824" returned: 0 in 0.642s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:22 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 Sep 07 09:48:22 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:22 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0" returned: 0 in 0.344s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-240560912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0581b747-b7a0-40cd-83c7-f1fe15c5fa11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577d7d1f8bf4b32a569094a58165f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:22Z,use_quota=True,user_id='c11d4c72d9e24bee9936597109683264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Creating volume 0581b747-b7a0-40cd-83c7-f1fe15c5fa11 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:22 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:22 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 1073741824 Sep 07 09:48:22 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a132c376-f447-4591-b70f-2687bba09a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caec325d-3ef4-4863-a0cf-c8c1e34cf5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Volume volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 (dc6934e5-13aa-48ac-802c-38cb0d7ba9a0): created successfully Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caec325d-3ef4-4863-a0cf-c8c1e34cf5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Flow 'volume_create_manager' (4e0bdaa1-271a-4670-a743-ccd8120f00f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:22 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-46120dee-299f-4a27-a61d-963908eebe98 tempest-VolumesListAdminTestJSON-1266064874 None] Created volume successfully. Sep 07 09:48:23 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 1073741824" returned: 0 in 0.535s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:23 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 Sep 07 09:48:23 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:23 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11" returned: 0 in 0.423s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831b9fff-b6a0-4c0a-8d93-719ae7ab7a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9e704f-c88b-4480-961e-32facac81b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Volume volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 (0581b747-b7a0-40cd-83c7-f1fe15c5fa11): created successfully Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9e704f-c88b-4480-961e-32facac81b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Flow 'volume_create_manager' (be4e00d6-be19-47af-b6a2-1be1c0b3bed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-39d08dc0-3376-47b2-8468-d4e202bcb31b tempest-AttachVolumeNegativeTest-1432735598 None] Created volume successfully. Sep 07 09:48:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-8ba14aac-6d8e-40dd-8d1d-ad02d82ecfbc req-03c5988b-6ec6-4844-b039-2f973f7e5485 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-8ba14aac-6d8e-40dd-8d1d-ad02d82ecfbc req-03c5988b-6ec6-4844-b039-2f973f7e5485 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-8ba14aac-6d8e-40dd-8d1d-ad02d82ecfbc req-03c5988b-6ec6-4844-b039-2f973f7e5485 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-8ba14aac-6d8e-40dd-8d1d-ad02d82ecfbc req-03c5988b-6ec6-4844-b039-2f973f7e5485 tempest-ServerActionsTestOtherA-511722583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-56becc42-15b9-4dc0-991d-0445c52577a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22664f48-1edc-48f7-ad0f-ddc326bcc7a3', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:48:24 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-8ba14aac-6d8e-40dd-8d1d-ad02d82ecfbc req-03c5988b-6ec6-4844-b039-2f973f7e5485 tempest-ServerActionsTestOtherA-511722583 None] attachment_update completed successfully. Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Flow 'volume_create_manager' (2e83f811-7c34-4a39-b5e5-7c12a6658d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b6bea-8739-4575-8130-87fe94faadaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b6bea-8739-4575-8130-87fe94faadaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27328004-6694-40dc-910f-2e29e201045c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25bbafe38c143d4bb599daf2eeab655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:25Z,use_quota=True,user_id='58bd65d82fd74cceafb379732e593000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b982b590-adf1-4034-b718-2185e70f1725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b982b590-adf1-4034-b718-2185e70f1725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a6cc59-14b9-44f9-98a0-4a450860c4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a6cc59-14b9-44f9-98a0-4a450860c4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27328004-6694-40dc-910f-2e29e201045c', 'volume_name': 'volume-27328004-6694-40dc-910f-2e29e201045c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5477faa1-f761-437d-b16f-4aa0ff995614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5477faa1-f761-437d-b16f-4aa0ff995614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5e0b26-a792-474b-8077-ef0a57bf75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:25 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Volume 27328004-6694-40dc-910f-2e29e201045c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27328004-6694-40dc-910f-2e29e201045c', 'volume_size': 1} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27328004-6694-40dc-910f-2e29e201045c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25bbafe38c143d4bb599daf2eeab655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:25Z,use_quota=True,user_id='58bd65d82fd74cceafb379732e593000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Creating volume 27328004-6694-40dc-910f-2e29e201045c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:25 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:25 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c 1073741824 Sep 07 09:48:25 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:25 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c 1073741824" returned: 0 in 0.659s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-54ef11e1-2318-440a-9d96-6c666d584421 req-6635fed8-8728-4dcf-ac80-67cc4cbe94e7 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:25 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c Sep 07 09:48:25 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:26 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c" returned: 0 in 0.287s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-54ef11e1-2318-440a-9d96-6c666d584421 req-6635fed8-8728-4dcf-ac80-67cc4cbe94e7 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.331s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5e0b26-a792-474b-8077-ef0a57bf75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27328004-6694-40dc-910f-2e29e201045c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87b97b2-39ea-4d0a-b200-2cecdb6482eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-54ef11e1-2318-440a-9d96-6c666d584421 req-6635fed8-8728-4dcf-ac80-67cc4cbe94e7 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:26 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Volume volume-27328004-6694-40dc-910f-2e29e201045c (27328004-6694-40dc-910f-2e29e201045c): created successfully Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87b97b2-39ea-4d0a-b200-2cecdb6482eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Flow 'volume_create_manager' (2e83f811-7c34-4a39-b5e5-7c12a6658d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8d4167e2-3b1b-49ac-9380-3cf1d047f7a4 tempest-VolumesListAdminTestJSON-930973084 None] Created volume successfully. Sep 07 09:48:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-54ef11e1-2318-440a-9d96-6c666d584421 req-6635fed8-8728-4dcf-ac80-67cc4cbe94e7 tempest-AttachVolumeNegativeTest-1432735598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11dd7238-bb7c-4c41-bbf7-68148ee79242', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:48:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-54ef11e1-2318-440a-9d96-6c666d584421 req-6635fed8-8728-4dcf-ac80-67cc4cbe94e7 tempest-AttachVolumeNegativeTest-1432735598 None] attachment_update completed successfully. Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Acquiring lock "cinder-27328004-6694-40dc-910f-2e29e201045c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Lock "cinder-27328004-6694-40dc-910f-2e29e201045c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Acquiring lock "cinder-quobyte-27328004-6694-40dc-910f-2e29e201045c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Lock "cinder-quobyte-27328004-6694-40dc-910f-2e29e201045c" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d456e5-a677-478b-8cb9-cdefb86b6981]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "cinder-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "cinder-quobyte-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:27 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c Sep 07 09:48:27 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-quobyte-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0" acquired by "delete_volume" :: waited 0.052s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[451c1e3c-ba73-4036-a3fc-e6051badd1a9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:28 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 Sep 07 09:48:28 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:28 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c" returned: 0 in 0.738s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:28 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c Sep 07 09:48:28 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:28 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0" returned: 0 in 0.925s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:28 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0 Sep 07 09:48:28 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:28 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-27328004-6694-40dc-910f-2e29e201045c" returned: 0 in 0.620s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Lock "cinder-quobyte-27328004-6694-40dc-910f-2e29e201045c" released by "delete_volume" :: held 1.449s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:28 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Created reservations ['7e64c20d-66c0-473d-bf28-094829b155dd', '6f98c737-3440-4749-b194-f1187429f2ff', '607ba759-e968-44cf-9684-28bc678de28b', 'c154744a-add7-473a-af11-b4575af579c4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:29 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0" returned: 0 in 0.503s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-quobyte-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0" released by "delete_volume" :: held 1.512s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:29 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:48:29 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Created reservations ['9e27e5cd-6b97-41dc-83d3-479761a4e233', 'eafc9540-b45e-4db3-82f1-34aa76737ba8', '88788076-8c0c-49dd-b181-95b7483a091f', '6dfa8d82-e04e-4905-849c-560e35429c7a'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:29 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:48:29 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:29 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.480s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:48:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Deleted volume successfully. Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7dbf9f09-23ae-42af-97d8-04bd76f810c7 tempest-VolumesListAdminTestJSON-930973084 None] Lock "cinder-27328004-6694-40dc-910f-2e29e201045c-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:29 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.516s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:48:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Deleted volume successfully. Sep 07 09:48:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f16e3031-b888-4d7d-8369-11d5c8c558f0 tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-dc6934e5-13aa-48ac-802c-38cb0d7ba9a0-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "cinder-e0842fc3-75ad-44d7-9aed-74e5b107f899-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-e0842fc3-75ad-44d7-9aed-74e5b107f899-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "cinder-quobyte-e0842fc3-75ad-44d7-9aed-74e5b107f899" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-quobyte-e0842fc3-75ad-44d7-9aed-74e5b107f899" acquired by "delete_volume" :: waited 0.046s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6041eb05-601f-41d7-970e-5c33083d0573]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:30 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 Sep 07 09:48:30 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:30 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899" returned: 0 in 0.801s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:31 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899 Sep 07 09:48:31 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:31 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0842fc3-75ad-44d7-9aed-74e5b107f899" returned: 0 in 0.428s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-quobyte-e0842fc3-75ad-44d7-9aed-74e5b107f899" released by "delete_volume" :: held 1.310s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Created reservations ['c9921d70-87e1-4bc4-8d40-1947150d85df', '718bd1a9-4e5f-4016-b635-26f408e500df', '1b9746ce-2432-4d4e-bf64-9ff84838f632', '8730f2d4-d4d3-499d-b328-51c2d5577fc1'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:31 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:48:31 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:32 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.574s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:48:32 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Deleted volume successfully. Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Flow 'volume_create_manager' (05491cae-514e-4d9c-a71c-ee2ee26df7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981cbcaf-590a-450e-8a6d-b8ee12b7f7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-21b1c1cc-f8c9-4e78-8e88-2009c463c31f tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-e0842fc3-75ad-44d7-9aed-74e5b107f899-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981cbcaf-590a-450e-8a6d-b8ee12b7f7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1497645923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde5de1d-bad6-466e-bc3b-f8b9f92b012a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ca6971062048afafd26a05f2a2e90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:32Z,use_quota=True,user_id='3b078c70d2ef4b0aab8d7789e4c60ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4a8ff2-1b41-4625-af18-b3c770533d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4a8ff2-1b41-4625-af18-b3c770533d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02014634-b999-49ca-9f03-c20e904f609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02014634-b999-49ca-9f03-c20e904f609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde5de1d-bad6-466e-bc3b-f8b9f92b012a', 'volume_name': 'volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a599ae-fdb6-492a-a06d-2274172a854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a599ae-fdb6-492a-a06d-2274172a854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f074c48-3227-4b05-a55a-e75c06fec558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:32 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Volume dde5de1d-bad6-466e-bc3b-f8b9f92b012a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a', 'volume_size': 1} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1497645923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde5de1d-bad6-466e-bc3b-f8b9f92b012a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ca6971062048afafd26a05f2a2e90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:32Z,use_quota=True,user_id='3b078c70d2ef4b0aab8d7789e4c60ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Creating volume dde5de1d-bad6-466e-bc3b-f8b9f92b012a {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:32 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:32 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a 1073741824 Sep 07 09:48:32 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "cinder-37ab09d4-bc7d-4bc7-b184-714e84d48b30-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-37ab09d4-bc7d-4bc7-b184-714e84d48b30-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "cinder-quobyte-37ab09d4-bc7d-4bc7-b184-714e84d48b30" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-quobyte-37ab09d4-bc7d-4bc7-b184-714e84d48b30" acquired by "delete_volume" :: waited 0.041s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[870144be-4486-4979-b036-826187a8abe0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:33 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 Sep 07 09:48:33 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:33 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a 1073741824" returned: 0 in 0.874s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:33 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a Sep 07 09:48:33 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:33 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30" returned: 0 in 0.545s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:33 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30 Sep 07 09:48:33 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:33 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a" returned: 0 in 0.358s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f074c48-3227-4b05-a55a-e75c06fec558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a7cfab-2104-4892-83a1-8940a52405d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:33 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Volume volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a (dde5de1d-bad6-466e-bc3b-f8b9f92b012a): created successfully Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a7cfab-2104-4892-83a1-8940a52405d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Flow 'volume_create_manager' (05491cae-514e-4d9c-a71c-ee2ee26df7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:33 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-908caede-0752-4819-89b9-83a7ee0f26f3 tempest-VolumesMetadataTest-2064386894 None] Created volume successfully. Sep 07 09:48:34 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37ab09d4-bc7d-4bc7-b184-714e84d48b30" returned: 0 in 0.650s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-quobyte-37ab09d4-bc7d-4bc7-b184-714e84d48b30" released by "delete_volume" :: held 1.303s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Created reservations ['b8bbcfa8-7fcf-4d0a-9816-99572ecbbe18', '05a04d4d-ed2c-4f3a-90c9-4ea968f06034', '0d3aa8c3-6f7e-4b61-82b1-fa3d196e948b', 'd691ad64-8442-45ef-b23f-6c543979bff3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:34 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:48:34 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:35 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.732s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:35 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:48:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Deleted volume successfully. Sep 07 09:48:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91cff715-0352-4ef2-9c8b-53b89731215b tempest-VolumesListAdminTestJSON-1266064874 None] Lock "cinder-37ab09d4-bc7d-4bc7-b184-714e84d48b30-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Acquiring lock "cinder-dde5de1d-bad6-466e-bc3b-f8b9f92b012a-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Lock "cinder-dde5de1d-bad6-466e-bc3b-f8b9f92b012a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Acquiring lock "cinder-quobyte-dde5de1d-bad6-466e-bc3b-f8b9f92b012a" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Lock "cinder-quobyte-dde5de1d-bad6-466e-bc3b-f8b9f92b012a" acquired by "delete_volume" :: waited 0.032s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:36 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f1ad1-5612-4ded-8f47-465ae33a347a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:37 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a Sep 07 09:48:37 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:37 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a" returned: 0 in 0.671s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:37 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a Sep 07 09:48:37 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:38 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dde5de1d-bad6-466e-bc3b-f8b9f92b012a" returned: 0 in 0.532s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Lock "cinder-quobyte-dde5de1d-bad6-466e-bc3b-f8b9f92b012a" released by "delete_volume" :: held 1.328s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Created reservations ['65a3cf48-af86-4ee8-9f20-18d61965673e', 'f70fcda8-a996-4a79-8c69-6523a26b4e22', '6df32d3a-9c59-454b-b109-66ab251f2d08', 'dbf51824-4357-45f8-ad27-7a51eb39d67b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:38 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:48:38 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:38 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.372s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:48:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Deleted volume successfully. Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=120,cinder:UPDATE=126,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:48:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c92942e4-a3b4-4685-9048-38bbc84ec3b7 tempest-VolumesMetadataTest-2064386894 None] Lock "cinder-dde5de1d-bad6-466e-bc3b-f8b9f92b012a-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:41 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:48:41 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:41 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.360s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:48:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:48:47 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=118,cinder:UPDATE=136,cinder:DELETE=10,cinder:INSERT=36 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Flow 'volume_create_manager' (9da9af75-d048-4ee3-a88c-ba0611ae7314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a6ed49-d5af-4c1c-9f64-f69f857dd4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a6ed49-d5af-4c1c-9f64-f69f857dd4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1858629224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc104098-9321-46c8-ac4d-88f8e54cde25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f660cad024481dbe03ceabb4ce7e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:49Z,use_quota=True,user_id='4af0a222ba48499da9730c3e1f8105c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b875f47-adf0-4f1d-a670-253d6aef297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b875f47-adf0-4f1d-a670-253d6aef297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ff1992-aa81-4a04-803f-f33e444dddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ff1992-aa81-4a04-803f-f33e444dddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc104098-9321-46c8-ac4d-88f8e54cde25', 'volume_name': 'volume-cc104098-9321-46c8-ac4d-88f8e54cde25', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cbea34-9f9f-4016-a405-a3d7ed57e1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cbea34-9f9f-4016-a405-a3d7ed57e1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2737864-0f0a-4ede-bf70-3b7fa63525b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:49 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Volume cc104098-9321-46c8-ac4d-88f8e54cde25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc104098-9321-46c8-ac4d-88f8e54cde25', 'volume_size': 1} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1858629224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc104098-9321-46c8-ac4d-88f8e54cde25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f660cad024481dbe03ceabb4ce7e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:49Z,use_quota=True,user_id='4af0a222ba48499da9730c3e1f8105c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Creating volume cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:49 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:49 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 1073741824 Sep 07 09:48:49 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:50 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 1073741824" returned: 0 in 0.844s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:50 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 Sep 07 09:48:50 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:51 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25" returned: 0 in 0.546s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2737864-0f0a-4ede-bf70-3b7fa63525b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc104098-9321-46c8-ac4d-88f8e54cde25', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cba6e85-461d-4a80-b8c5-fba902eb96c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:51 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Volume volume-cc104098-9321-46c8-ac4d-88f8e54cde25 (cc104098-9321-46c8-ac4d-88f8e54cde25): created successfully Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cba6e85-461d-4a80-b8c5-fba902eb96c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Flow 'volume_create_manager' (9da9af75-d048-4ee3-a88c-ba0611ae7314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-41534704-fc28-44ef-8e13-3e808d5e133a tempest-VolumesDeleteCascade-65741673 None] Created volume successfully. Sep 07 09:48:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-44ff34c2-15e5-4f53-b38f-38ad9df17d9e req-923da329-b259-4eb2-8d3b-f317387d0390 tempest-ServerActionsTestOtherA-511722583 None] Terminate volume connection completed successfully. Sep 07 09:48:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-44ff34c2-15e5-4f53-b38f-38ad9df17d9e req-923da329-b259-4eb2-8d3b-f317387d0390 tempest-ServerActionsTestOtherA-511722583 None] Deleting attachment 22664f48-1edc-48f7-ad0f-ddc326bcc7a3. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:48:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Creating offline snapshot c65f37c8-2516-4470-ad29-184b5012124c of volume cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:48:52 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d00eb3d-cfa3-4cf9-affd-17c83c43bb0b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:52 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 Sep 07 09:48:52 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Flow 'volume_create_manager' (bc9be6d6-73bf-42a8-b4a3-b13a58cb72bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd901198-23ea-442e-861c-a171b007b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd901198-23ea-442e-861c-a171b007b847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2000426747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7bc7f3-39ed-43ea-8d6c-97bea30df817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba043271f87433cb57cfa8750650358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:53Z,use_quota=True,user_id='66d989c1f11142f6b2d5671611d5e36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5c36ae-ca83-487b-bd7e-5db9a555591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5c36ae-ca83-487b-bd7e-5db9a555591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d9a003-20ba-4543-b280-6a14827c2416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:53 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d9a003-20ba-4543-b280-6a14827c2416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7bc7f3-39ed-43ea-8d6c-97bea30df817', 'volume_name': 'volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2dd31e-083e-4540-a814-e5e7a8a530a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2dd31e-083e-4540-a814-e5e7a8a530a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba6ac79-a793-42bc-8e97-69f634f3099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:53 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Volume 9f7bc7f3-39ed-43ea-8d6c-97bea30df817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817', 'volume_size': 1} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25" returned: 0 in 0.773s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:53 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c 1G Sep 07 09:48:53 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:53 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c 1G" returned: 0 in 0.490s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc104098-9321-46c8-ac4d-88f8e54cde25 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:53 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc104098-9321-46c8-ac4d-88f8e54cde25 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c Sep 07 09:48:53 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:54 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc104098-9321-46c8-ac4d-88f8e54cde25 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c" returned: 0 in 0.428s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:54 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c is being set with open permissions: ugo+rw Sep 07 09:48:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:54 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c Sep 07 09:48:54 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-44ff34c2-15e5-4f53-b38f-38ad9df17d9e req-32698a01-3e1b-4974-9d6b-f3cbf3f86df8 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:54 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c" returned: 0 in 0.287s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:54 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.info Sep 07 09:48:54 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:54 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.info" returned: 0 in 0.264s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:54 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.info is being set with open permissions: ugo+rw Sep 07 09:48:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:54 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.info Sep 07 09:48:54 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:55 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.info" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.655s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2000426747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7bc7f3-39ed-43ea-8d6c-97bea30df817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba043271f87433cb57cfa8750650358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:48:53Z,use_quota=True,user_id='66d989c1f11142f6b2d5671611d5e36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Creating volume 9f7bc7f3-39ed-43ea-8d6c-97bea30df817 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:48:55 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:55 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 1073741824 Sep 07 09:48:55 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e8252616-8f26-4d32-8ed6-15f3586bfe3f tempest-VolumesDeleteCascade-65741673 None] Create snapshot completed successfully Sep 07 09:48:55 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 1073741824" returned: 0 in 0.524s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:55 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 Sep 07 09:48:55 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:48:56 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817" returned: 0 in 0.294s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-44ff34c2-15e5-4f53-b38f-38ad9df17d9e req-32698a01-3e1b-4974-9d6b-f3cbf3f86df8 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.557s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba6ac79-a793-42bc-8e97-69f634f3099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde168ff-3ec6-438a-96e6-55e93d9b8e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-44ff34c2-15e5-4f53-b38f-38ad9df17d9e req-32698a01-3e1b-4974-9d6b-f3cbf3f86df8 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.228s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:48:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Volume volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 (9f7bc7f3-39ed-43ea-8d6c-97bea30df817): created successfully Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde168ff-3ec6-438a-96e6-55e93d9b8e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Flow 'volume_create_manager' (bc9be6d6-73bf-42a8-b4a3-b13a58cb72bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:48:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-da807ca9-b725-435d-9063-faa31efd5d79 tempest-VolumesTransfersV355Test-2126522622 None] Created volume successfully. Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Creating offline snapshot 3b3f5725-0642-4480-88de-9c73db22735a of volume cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-44ff34c2-15e5-4f53-b38f-38ad9df17d9e req-32698a01-3e1b-4974-9d6b-f3cbf3f86df8 tempest-ServerActionsTestOtherA-511722583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-56becc42-15b9-4dc0-991d-0445c52577a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d40db72-7753-46ec-ade1-0247206d7dbf', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[67254957-48a3-4149-97a4-d9a9c8d39949]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-44ff34c2-15e5-4f53-b38f-38ad9df17d9e req-32698a01-3e1b-4974-9d6b-f3cbf3f86df8 tempest-ServerActionsTestOtherA-511722583 None] attachment_update completed successfully. Sep 07 09:48:56 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c Sep 07 09:48:56 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:56 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c" returned: 0 in 0.666s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc104098-9321-46c8-ac4d-88f8e54cde25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:48:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:57 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a 1G Sep 07 09:48:57 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cefb8ae9-cbf7-4817-ad34-60acec6278ed tempest-VolumesTransfersV355Test-161431479 None] Transfer volume completed successfully. Sep 07 09:48:57 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a 1G" returned: 0 in 0.877s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:57 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a Sep 07 09:48:57 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:58 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a" returned: 0 in 0.719s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:58 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a is being set with open permissions: ugo+rw Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:58 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a Sep 07 09:48:58 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Acquiring lock "cinder-9f7bc7f3-39ed-43ea-8d6c-97bea30df817-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-9f7bc7f3-39ed-43ea-8d6c-97bea30df817-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Acquiring lock "cinder-quobyte-9f7bc7f3-39ed-43ea-8d6c-97bea30df817" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-quobyte-9f7bc7f3-39ed-43ea-8d6c-97bea30df817" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:58 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[98627891-f9dc-4f37-bf1f-275eb366c9fd]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a" returned: 0 in 0.429s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.980s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:48:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e8d95d82-83b8-484e-95ad-cbdb11e3962c tempest-VolumesDeleteCascade-65741673 None] Create snapshot completed successfully Sep 07 09:48:59 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 Sep 07 09:48:59 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-cc104098-9321-46c8-ac4d-88f8e54cde25-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-cc104098-9321-46c8-ac4d-88f8e54cde25-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Performing cascade delete. {{(pid=87290) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-3b3f5725-0642-4480-88de-9c73db22735a-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-3b3f5725-0642-4480-88de-9c73db22735a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-3b3f5725-0642-4480-88de-9c73db22735a" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-3b3f5725-0642-4480-88de-9c73db22735a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Deleting offline snapshot 3b3f5725-0642-4480-88de-9c73db22735a of volume cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:48:59 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] snapshot_file for this snap is: volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817" returned: 0 in 0.609s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffea431-db60-42e6-9daf-5178850d2d32]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:48:59 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817 Sep 07 09:48:59 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:59 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a Sep 07 09:48:59 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:48:59 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9f7bc7f3-39ed-43ea-8d6c-97bea30df817" returned: 0 in 0.322s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:48:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-quobyte-9f7bc7f3-39ed-43ea-8d6c-97bea30df817" released by "delete_volume" :: held 1.011s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Created reservations ['b86293da-cdda-47e6-9e6d-ec920725841d', 'ecf3b1ce-68c0-48e6-a2a3-d51aea28f34d', '4a8e023a-b026-4d11-b14a-0bf496b04b99', 'a75a1237-3af1-47ed-86f0-2a923da77fad'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:00 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a" returned: 0 in 0.533s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc104098-9321-46c8-ac4d-88f8e54cde25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69f68dc-2148-450c-a8eb-3511ace0cb11]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:00 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:00 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:00 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c Sep 07 09:49:00 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:00 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.370s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:00 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Deleted volume successfully. Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5d2befe4-1a31-4dbd-89d4-eac88015154f tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-9f7bc7f3-39ed-43ea-8d6c-97bea30df817-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:00 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c" returned: 0 in 0.664s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc104098-9321-46c8-ac4d-88f8e54cde25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:00 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a Sep 07 09:49:00 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:01 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a" returned: 0 in 0.525s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:01 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a Sep 07 09:49:01 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:01 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.3b3f5725-0642-4480-88de-9c73db22735a" returned: 0 in 0.435s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-3b3f5725-0642-4480-88de-9c73db22735a" released by "_delete_snapshot" :: held 2.356s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" released by "delete_snapshot" :: held 2.399s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Flow 'volume_create_manager' (0f20e1d4-23fb-4cf5-b7e7-bf08a25e4596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b310e9e-9bb9-4860-bbc7-b66703280467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b310e9e-9bb9-4860-bbc7-b66703280467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2095010600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba043271f87433cb57cfa8750650358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:02Z,use_quota=True,user_id='66d989c1f11142f6b2d5671611d5e36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29e2d07-d530-42b3-8e93-ee845cadf762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29e2d07-d530-42b3-8e93-ee845cadf762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d56a0b-527c-4bd4-84cc-73ada9442ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d56a0b-527c-4bd4-84cc-73ada9442ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6', 'volume_name': 'volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc54663-51ba-4bbd-87e8-26296d722cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc54663-51ba-4bbd-87e8-26296d722cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0005ee00-5cbe-439e-9f23-56834bb49a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:02 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Volume 9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6', 'volume_size': 1} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2095010600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba043271f87433cb57cfa8750650358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:02Z,use_quota=True,user_id='66d989c1f11142f6b2d5671611d5e36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Creating volume 9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:49:02 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Created reservations ['23f1ac1b-30cb-443c-a31b-54afb2fcb94d', 'c207667d-7cb3-47d0-a6a4-9feccc4e1450', '70501ac3-0fcd-4c0d-ae35-9e34cee93124', '749b7b8a-57b4-400c-a64f-26a7f9714a8b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:02 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 1073741824 Sep 07 09:49:02 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Delete snapshot completed successfully. Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-3b3f5725-0642-4480-88de-9c73db22735a-delete_snapshot" released by "delete_snapshot" :: held 2.947s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-c65f37c8-2516-4470-ad29-184b5012124c-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-c65f37c8-2516-4470-ad29-184b5012124c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-c65f37c8-2516-4470-ad29-184b5012124c" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-c65f37c8-2516-4470-ad29-184b5012124c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Deleting offline snapshot c65f37c8-2516-4470-ad29-184b5012124c of volume cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] snapshot_file for this snap is: volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc85456-9ee2-4fdf-bb9c-243572d3f287]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:02 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c Sep 07 09:49:02 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:03 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 1073741824" returned: 0 in 0.907s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:03 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 Sep 07 09:49:03 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:03 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c" returned: 0 in 0.617s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc104098-9321-46c8-ac4d-88f8e54cde25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[86403fcb-3edf-43ae-9a26-75c31100a8d0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:03 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 Sep 07 09:49:03 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:03 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6" returned: 0 in 0.453s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0005ee00-5cbe-439e-9f23-56834bb49a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e540f66-64cc-4a87-8035-425a7c7c56e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Volume volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 (9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6): created successfully Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e540f66-64cc-4a87-8035-425a7c7c56e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Flow 'volume_create_manager' (0f20e1d4-23fb-4cf5-b7e7-bf08a25e4596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e777df50-7358-4396-adc7-ee8d4f4a66d6 tempest-VolumesTransfersV355Test-2126522622 None] Created volume successfully. Sep 07 09:49:03 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25" returned: 0 in 0.593s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:03 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c Sep 07 09:49:03 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:04 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c" returned: 0 in 0.455s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:04 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c Sep 07 09:49:04 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Acquiring lock "cinder-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Acquiring lock "cinder-quobyte-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-quobyte-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6e533e-977c-4861-8f26-45783b2148e8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:04 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25.c65f37c8-2516-4470-ad29-184b5012124c" returned: 0 in 0.388s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:04 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 Sep 07 09:49:04 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-c65f37c8-2516-4470-ad29-184b5012124c" released by "_delete_snapshot" :: held 2.227s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" released by "delete_snapshot" :: held 2.270s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Created reservations ['4c86566a-4f01-4c3f-b7be-5ee923ed7374', 'f353e74d-bef4-478e-bd2d-81d96f88a2d7', '4244bed2-4c43-4b52-9111-0767f880f509', '5efbdbc4-7584-498d-b100-2701882c4ef1'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Delete snapshot completed successfully. Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-c65f37c8-2516-4470-ad29-184b5012124c-delete_snapshot" released by "delete_snapshot" :: held 2.512s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Snapshots deleted, issuing volume delete {{(pid=87290) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 09:49:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfe251f-c995-48cb-85df-7409f4f1606d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:05 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6" returned: 0 in 0.479s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:05 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6 Sep 07 09:49:05 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:05 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 Sep 07 09:49:05 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:05 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-quobyte-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6" released by "delete_volume" :: held 0.822s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Created reservations ['6f446c6e-f771-41fc-ad6e-60e6963baf55', 'c558ed0e-b51f-49a0-b11a-951d2f15bb6b', '86cb57f1-4c44-4408-9b4f-d5eae708bf0d', 'fac4c9f8-da61-46ee-9e73-786da849ed04'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:05 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25" returned: 0 in 0.434s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:05 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25 Sep 07 09:49:05 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:05 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:05 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:05 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cc104098-9321-46c8-ac4d-88f8e54cde25" returned: 0 in 0.369s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-cc104098-9321-46c8-ac4d-88f8e54cde25" released by "delete_volume" :: held 0.880s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:05 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.348s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Deleted volume successfully. Sep 07 09:49:05 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Created reservations ['aba82fc0-d372-4781-81b7-ef5b35e65820', '8d310d0e-1cb8-42f3-8855-12f404df74c3', '5f3775bb-4df3-4ecb-a92f-e9c670cce13e', '97674256-6227-4a93-9646-41d6badbd55d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d33a300-1205-4f38-902c-6516d5b33709 tempest-VolumesTransfersV355Test-1294367085 None] Lock "cinder-9af8f38e-0f27-4c81-9cc5-9f101a6bb7a6-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:06 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:06 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:06 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.472s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Deleted volume successfully. Sep 07 09:49:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-55178b74-1b36-4c62-ac1e-8abe26b3670c tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-cc104098-9321-46c8-ac4d-88f8e54cde25-delete_volume" released by "delete_volume" :: held 7.371s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Flow 'volume_create_manager' (15552daa-ee0d-4630-8669-ff2bbb859f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c37385-e26b-4045-b07b-645f2cc76fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c37385-e26b-4045-b07b-645f2cc76fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-527695341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e3e33f-b408-46d2-9281-88b4b3c12781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f660cad024481dbe03ceabb4ce7e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:08Z,use_quota=True,user_id='4af0a222ba48499da9730c3e1f8105c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b3929e-7e49-47ee-991d-c822e52eb2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b3929e-7e49-47ee-991d-c822e52eb2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e8d61f-0b17-4553-8933-c74b72646b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e8d61f-0b17-4553-8933-c74b72646b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e3e33f-b408-46d2-9281-88b4b3c12781', 'volume_name': 'volume-83e3e33f-b408-46d2-9281-88b4b3c12781', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06cac53b-c957-4368-960b-5b06cbfe2ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06cac53b-c957-4368-960b-5b06cbfe2ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ba21f1-96a3-455b-955b-06c624891900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:07 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Volume 83e3e33f-b408-46d2-9281-88b4b3c12781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e3e33f-b408-46d2-9281-88b4b3c12781', 'volume_size': 1} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-527695341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e3e33f-b408-46d2-9281-88b4b3c12781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f660cad024481dbe03ceabb4ce7e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:08Z,use_quota=True,user_id='4af0a222ba48499da9730c3e1f8105c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Creating volume 83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:49:07 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:49:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:07 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 1073741824 Sep 07 09:49:07 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:08 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 1073741824" returned: 0 in 0.638s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:08 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 Sep 07 09:49:08 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:08 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781" returned: 0 in 0.334s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ba21f1-96a3-455b-955b-06c624891900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e3e33f-b408-46d2-9281-88b4b3c12781', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d798601-a30b-4ff7-a25e-35a1f61c96c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Volume volume-83e3e33f-b408-46d2-9281-88b4b3c12781 (83e3e33f-b408-46d2-9281-88b4b3c12781): created successfully Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d798601-a30b-4ff7-a25e-35a1f61c96c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Flow 'volume_create_manager' (15552daa-ee0d-4630-8669-ff2bbb859f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4d804772-a5fa-418a-a315-98f0510b7841 tempest-VolumesDeleteCascade-65741673 None] Created volume successfully. Sep 07 09:49:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Creating offline snapshot ecc6e7be-fce5-4796-b003-2c47f66714d4 of volume 83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:49:10 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fdb469-7eb9-447b-ace9-47d3d8876a3c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:10 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 Sep 07 09:49:10 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:10 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781" returned: 0 in 0.442s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:10 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 1G Sep 07 09:49:10 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:11 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 1G" returned: 0 in 0.666s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e3e33f-b408-46d2-9281-88b4b3c12781 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:11 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e3e33f-b408-46d2-9281-88b4b3c12781 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 Sep 07 09:49:11 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:11 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e3e33f-b408-46d2-9281-88b4b3c12781 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4" returned: 0 in 0.645s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:11 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 is being set with open permissions: ugo+rw Sep 07 09:49:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:11 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 Sep 07 09:49:11 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:12 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4" returned: 0 in 0.430s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:12 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.info Sep 07 09:49:12 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:12 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.info" returned: 0 in 0.657s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:13 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.info is being set with open permissions: ugo+rw Sep 07 09:49:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:13 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.info Sep 07 09:49:13 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:13 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.info" returned: 0 in 0.423s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.446s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cdd9dc99-9cd6-4487-b796-760f0b579aba tempest-VolumesDeleteCascade-65741673 None] Create snapshot completed successfully Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Flow 'volume_create_manager' (828f9442-677a-4f34-9553-85ddaa01b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f282476-1c92-4d8c-8a46-bd92956427b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f282476-1c92-4d8c-8a46-bd92956427b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2013195107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a9573f-3c64-4b70-b850-eacfdd7e78c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f660cad024481dbe03ceabb4ce7e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ecc6e7be-fce5-4796-b003-2c47f66714d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:15Z,use_quota=True,user_id='4af0a222ba48499da9730c3e1f8105c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603752a9-e010-46d1-98cb-a5dcf536120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603752a9-e010-46d1-98cb-a5dcf536120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9315f55-5d48-435f-9b87-e577bdb95ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9315f55-5d48-435f-9b87-e577bdb95ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23a9573f-3c64-4b70-b850-eacfdd7e78c5', 'volume_name': 'volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5', 'volume_size': 1, 'snapshot_id': 'ecc6e7be-fce5-4796-b003-2c47f66714d4'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005c0a3f-0957-4c3d-b4a3-7741d369be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005c0a3f-0957-4c3d-b4a3-7741d369be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1613faa-c7f5-4dc4-a572-ccd4cfab7c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Volume 23a9573f-3c64-4b70-b850-eacfdd7e78c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5', 'volume_size': 1, 'snapshot_id': 'ecc6e7be-fce5-4796-b003-2c47f66714d4'} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-ecc6e7be-fce5-4796-b003-2c47f66714d4-23a9573f-3c64-4b70-b850-eacfdd7e78c5" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-ecc6e7be-fce5-4796-b003-2c47f66714d4-23a9573f-3c64-4b70-b850-eacfdd7e78c5" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Creating volume 23a9573f-3c64-4b70-b850-eacfdd7e78c5 from snapshot ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-23a9573f-3c64-4b70-b850-eacfdd7e78c5" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-23a9573f-3c64-4b70-b850-eacfdd7e78c5" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] snapshot: ecc6e7be-fce5-4796-b003-2c47f66714d4, volume: 23a9573f-3c64-4b70-b850-eacfdd7e78c5, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[023be604-1b45-4e24-9d86-5d7ab82535c8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:15 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 Sep 07 09:49:15 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Flow 'volume_create_manager' (e80462c0-5cb5-4f75-9452-7c6c384a64a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93493faf-687b-47a2-b815-d8879c0fc9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93493faf-687b-47a2-b815-d8879c0fc9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-543534862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be12996-1a15-4e6c-8381-cc7a3b99751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532f4571002c4ad6bbce4cf39715c490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:16Z,use_quota=True,user_id='24fb051eb68c43dd813b7ae3591d4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bcef24-b089-4f1a-8e64-f6665ef0bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bcef24-b089-4f1a-8e64-f6665ef0bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef9f984-f4e3-428b-96a1-50dfc4835da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 09:49:15 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4" returned: 0 in 0.500s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e3e33f-b408-46d2-9281-88b4b3c12781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a0b14-9045-498a-b43a-f18738fd67ac]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:15 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 Sep 07 09:49:15 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef9f984-f4e3-428b-96a1-50dfc4835da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6be12996-1a15-4e6c-8381-cc7a3b99751d', 'volume_name': 'volume-6be12996-1a15-4e6c-8381-cc7a3b99751d', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5638754e-a58a-42ac-a541-1f3e7b4457f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5638754e-a58a-42ac-a541-1f3e7b4457f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d082b7-5a96-49de-bb8a-20606392d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Volume 6be12996-1a15-4e6c-8381-cc7a3b99751d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6be12996-1a15-4e6c-8381-cc7a3b99751d', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Trying to clone 6be12996-1a15-4e6c-8381-cc7a3b99751d from image 262465d0-5b79-4e49-bcf9-a496a478d70a at location (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 09:49:16 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781" returned: 0 in 0.455s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:16 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 Sep 07 09:49:16 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 09:49:16 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Image download 20.69 MB at 20.69 MB/s Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6fc643-9854-44eb-a4da-221890c886a8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:16 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD Sep 07 09:49:16 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:17 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:17 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a is fetched for user 24fb051eb68c43dd813b7ae3591d4ddb. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 09:49:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad39ff-177a-4ab5-8074-1ad1dce2c3b5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:17 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD Sep 07 09:49:17 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-fc5e419b-a705-42f1-a1d7-f009cabd230c req-27730524-b350-4d95-9792-8207a6aed7c7 tempest-AttachVolumeNegativeTest-1432735598 None] Terminate volume connection completed successfully. Sep 07 09:49:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-fc5e419b-a705-42f1-a1d7-f009cabd230c req-27730524-b350-4d95-9792-8207a6aed7c7 tempest-AttachVolumeNegativeTest-1432735598 None] Deleting attachment 11dd7238-bb7c-4c41-bbf7-68148ee79242. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:49:18 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:22 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5" returned: 0 in 5.833s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:49:22 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Converted 1024.00 MB image at 175.52 MB/s Sep 07 09:49:22 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 is being set with open permissions: ugo+rw Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:22 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 Sep 07 09:49:22 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:22 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5" returned: 0 in 0.368s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-23a9573f-3c64-4b70-b850-eacfdd7e78c5" released by "_copy_volume_from_snapshot" :: held 7.264s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-ecc6e7be-fce5-4796-b003-2c47f66714d4-23a9573f-3c64-4b70-b850-eacfdd7e78c5" released by "_create_volume_from_snapshot" :: held 7.338s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.361s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.554s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-543534862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be12996-1a15-4e6c-8381-cc7a3b99751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532f4571002c4ad6bbce4cf39715c490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:16Z,use_quota=True,user_id='24fb051eb68c43dd813b7ae3591d4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Creating volume 6be12996-1a15-4e6c-8381-cc7a3b99751d {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:49:22 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1613faa-c7f5-4dc4-a572-ccd4cfab7c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5', 'volume_size': 1, 'snapshot_id': 'ecc6e7be-fce5-4796-b003-2c47f66714d4'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:22 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 1073741824 Sep 07 09:49:22 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16dfb00c-5ba9-4d69-9b8d-27661db34f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Volume volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 (23a9573f-3c64-4b70-b850-eacfdd7e78c5): created successfully Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16dfb00c-5ba9-4d69-9b8d-27661db34f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Flow 'volume_create_manager' (828f9442-677a-4f34-9553-85ddaa01b833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:22 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4492d6a0-b9f9-411b-9e0f-7b8f68cbe200 tempest-VolumesDeleteCascade-65741673 None] Created volume successfully. Sep 07 09:49:23 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 1073741824" returned: 0 in 0.501s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:23 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d Sep 07 09:49:23 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-83e3e33f-b408-46d2-9281-88b4b3c12781-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-83e3e33f-b408-46d2-9281-88b4b3c12781-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Performing cascade delete. {{(pid=87290) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-ecc6e7be-fce5-4796-b003-2c47f66714d4-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-ecc6e7be-fce5-4796-b003-2c47f66714d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-83e3e33f-b408-46d2-9281-88b4b3c12781" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-83e3e33f-b408-46d2-9281-88b4b3c12781" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-ecc6e7be-fce5-4796-b003-2c47f66714d4" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-ecc6e7be-fce5-4796-b003-2c47f66714d4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Deleting offline snapshot ecc6e7be-fce5-4796-b003-2c47f66714d4 of volume 83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] snapshot_file for this snap is: volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb54ff-aaf5-4454-95e8-d1c8a79f4d7d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:23 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d" returned: 0 in 0.304s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Attempting download of 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 6be12996-1a15-4e6c-8381-cc7a3b99751d. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 09:49:23 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 Sep 07 09:49:23 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3268dea-4b4e-4654-9f77-1b0cbbcdb0c9]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_16zk2dof {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:23 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_16zk2dof Sep 07 09:49:23 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:23 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4" returned: 0 in 0.458s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e3e33f-b408-46d2-9281-88b4b3c12781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d4953-6289-436c-bf67-66255cd42556]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:23 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_16zk2dof" returned: 0 in 0.378s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_16zk2dof {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:24 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 Sep 07 09:49:24 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:24 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_16zk2dof Sep 07 09:49:24 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:24 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_16zk2dof" returned: 1 in 0.444s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_16zk2dof' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aef125-9ae6-4f91-a986-4b34f05e3158]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:24 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD Sep 07 09:49:24 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:24 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781" returned: 0 in 0.977s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:24 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 Sep 07 09:49:24 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:24 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] 262465d0-5b79-4e49-bcf9-a496a478d70a was qcow2, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 09:49:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:24 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d Sep 07 09:49:24 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:25 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4" returned: 0 in 0.685s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:25 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4 Sep 07 09:49:25 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:25 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781.ecc6e7be-fce5-4796-b003-2c47f66714d4" returned: 0 in 0.332s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-ecc6e7be-fce5-4796-b003-2c47f66714d4" released by "_delete_snapshot" :: held 2.599s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-83e3e33f-b408-46d2-9281-88b4b3c12781" released by "delete_snapshot" :: held 2.626s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Created reservations ['57b1a437-588b-46c2-9be4-11965087e529', 'f3d8d0d9-3dae-44d1-aa02-f233022b5f71', '964773cb-b526-4f09-96dc-30c62528e208', '8b520091-6532-445b-8abf-b1546c604d1e'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Delete snapshot completed successfully. Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-ecc6e7be-fce5-4796-b003-2c47f66714d4-delete_snapshot" released by "delete_snapshot" :: held 2.855s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Snapshots deleted, issuing volume delete {{(pid=87290) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-83e3e33f-b408-46d2-9281-88b4b3c12781" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-83e3e33f-b408-46d2-9281-88b4b3c12781" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7207e5-b7f2-4c27-bbf2-ff8308766492]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:26 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 Sep 07 09:49:26 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:26 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781" returned: 0 in 0.552s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:26 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781 Sep 07 09:49:26 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:27 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-da001385-396d-4ba0-aecd-663158af0d33 tempest-ServerActionsTestOtherA-511722583 None] Terminate volume connection completed successfully. Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-da001385-396d-4ba0-aecd-663158af0d33 tempest-ServerActionsTestOtherA-511722583 None] Deleting attachment 0d40db72-7753-46ec-ade1-0247206d7dbf. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-83e3e33f-b408-46d2-9281-88b4b3c12781" returned: 0 in 0.389s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-83e3e33f-b408-46d2-9281-88b4b3c12781" released by "delete_volume" :: held 1.061s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Created reservations ['d5669b78-0dfe-4114-ae53-82929c702927', '0755eb1c-de09-425d-98c0-b3e90b45191e', '7f2a584d-9573-4964-a581-42a56523736b', '75cba9a0-edac-4a76-a78b-686b41b300a4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "cinder-56becc42-15b9-4dc0-991d-0445c52577a0-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:27 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:27 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-56becc42-15b9-4dc0-991d-0445c52577a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "cinder-quobyte-56becc42-15b9-4dc0-991d-0445c52577a0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-quobyte-56becc42-15b9-4dc0-991d-0445c52577a0" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4fafea-0eea-4fa1-89f9-968df221cdc5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:27 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d" returned: 0 in 2.793s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_29t8na7ddevstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:49:27 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Converted 112.00 MB image at 40.08 MB/s Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:27 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 Sep 07 09:49:27 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:27 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 1G Sep 07 09:49:27 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:27 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.439s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Deleted volume successfully. Sep 07 09:49:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f2cabc61-944b-444b-82c4-990caf6ac77d tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-83e3e33f-b408-46d2-9281-88b4b3c12781-delete_volume" released by "delete_volume" :: held 4.696s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-23a9573f-3c64-4b70-b850-eacfdd7e78c5-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-23a9573f-3c64-4b70-b850-eacfdd7e78c5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "cinder-quobyte-23a9573f-3c64-4b70-b850-eacfdd7e78c5" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-23a9573f-3c64-4b70-b850-eacfdd7e78c5" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:28 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0" returned: 0 in 0.616s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[05132c15-adda-4c74-9b44-6320b0601173]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:28 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0 Sep 07 09:49:28 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:28 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 1G" returned: 0 in 0.569s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Downloaded image 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 6be12996-1a15-4e6c-8381-cc7a3b99751d successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a for user 24fb051eb68c43dd813b7ae3591d4ddb is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Marking volume 6be12996-1a15-4e6c-8381-cc7a3b99751d as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "cinder-4cc71185-971d-4019-9090-477700edf19b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Copying metadata from image 262465d0-5b79-4e49-bcf9-a496a478d70a to 6be12996-1a15-4e6c-8381-cc7a3b99751d. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Creating volume glance metadata for volume 6be12996-1a15-4e6c-8381-cc7a3b99751d backed by image 262465d0-5b79-4e49-bcf9-a496a478d70a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-4cc71185-971d-4019-9090-477700edf19b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:28 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 Sep 07 09:49:28 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "cinder-quobyte-4cc71185-971d-4019-9090-477700edf19b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-quobyte-4cc71185-971d-4019-9090-477700edf19b" acquired by "delete_volume" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa5437-6fcd-4e70-b2a2-891b69f7aea7]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d082b7-5a96-49de-bb8a-20606392d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be12996-1a15-4e6c-8381-cc7a3b99751d', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189518ed-6b30-44fe-af88-98298cc98381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:28 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-56becc42-15b9-4dc0-991d-0445c52577a0" returned: 0 in 0.390s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:28 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Volume volume-6be12996-1a15-4e6c-8381-cc7a3b99751d (6be12996-1a15-4e6c-8381-cc7a3b99751d): created successfully Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189518ed-6b30-44fe-af88-98298cc98381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Flow 'volume_create_manager' (e80462c0-5cb5-4f75-9452-7c6c384a64a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-quobyte-56becc42-15b9-4dc0-991d-0445c52577a0" released by "delete_volume" :: held 1.095s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2a22dadc-b352-408d-bddd-d2d2e216f3b9 tempest-VolumesExtendTest-1508450639 None] Created volume successfully. Sep 07 09:49:28 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b Sep 07 09:49:28 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.quota [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Created reservations ['ba0e7907-d840-4d1d-8557-c41e9d6f77d5', 'c513acf2-fada-4239-b14c-8d06a0502e3e', '05ea79c0-81b6-4448-991f-69b3d15ca982', 'acfb03fa-c571-41a1-9517-de4ff45186af'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:28 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5" returned: 0 in 0.544s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:28 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5 Sep 07 09:49:28 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:28 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:28 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:29 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b" returned: 0 in 0.530s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:29 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b Sep 07 09:49:29 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:29 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.299s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.manager [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Deleted volume successfully. Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-d398c8f4-dca7-4e22-9ded-d3c41e48ef63 req-abd9a5ae-b260-4ab6-ad03-22066675fcc7 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-56becc42-15b9-4dc0-991d-0445c52577a0-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:29 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23a9573f-3c64-4b70-b850-eacfdd7e78c5" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-quobyte-23a9573f-3c64-4b70-b850-eacfdd7e78c5" released by "delete_volume" :: held 1.026s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f379955e-eb30-4f94-8cc7-05adc4479f4b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Created reservations ['743e57c9-5266-4ceb-bac3-574161a0d45a', '28d26554-be67-4c2d-b017-a2fa829fa4cc', '4ce55645-d20e-422d-90b9-1c0f374d0da6', '97de1a50-28a7-4487-b7aa-5b5c445e8b14'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:29 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d Sep 07 09:49:29 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:29 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:29 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:29 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cc71185-971d-4019-9090-477700edf19b" returned: 0 in 0.448s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-quobyte-4cc71185-971d-4019-9090-477700edf19b" released by "delete_volume" :: held 1.060s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Created reservations ['b6eb7f8d-1583-429a-9bf2-99cfcdd06408', '23c9ba8e-c92d-4808-b0bc-42b18d380f3f', '6386f4a3-3141-4a18-8c18-98a6e481adde', '13eaadaf-4971-4b81-addf-defbd3eb7c5e'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:29 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.312s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:29 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Deleted volume successfully. Sep 07 09:49:29 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:29 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d" returned: 0 in 0.475s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 2G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ef6ef16b-6a20-4830-a75e-285a13d365a9 tempest-VolumesDeleteCascade-65741673 None] Lock "cinder-23a9573f-3c64-4b70-b850-eacfdd7e78c5-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d 2G" returned: 0 in 0.120s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.632s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fc8f8720-31ba-43c1-819a-4fd64a4de96c tempest-VolumesExtendTest-1508450639 None] Extend volume completed successfully. Sep 07 09:49:30 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Deleted volume successfully. Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0d0cdfec-71a4-4c32-9d86-459d8b70e031 tempest-ServerActionsTestOtherA-511722583 None] Lock "cinder-4cc71185-971d-4019-9090-477700edf19b-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "cinder-6be12996-1a15-4e6c-8381-cc7a3b99751d-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-6be12996-1a15-4e6c-8381-cc7a3b99751d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "cinder-quobyte-6be12996-1a15-4e6c-8381-cc7a3b99751d" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-6be12996-1a15-4e6c-8381-cc7a3b99751d" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c34b3d-8895-41d7-af63-144db9488f64]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:31 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d Sep 07 09:49:31 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:31 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d" returned: 0 in 0.788s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:31 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d Sep 07 09:49:31 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:31 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6be12996-1a15-4e6c-8381-cc7a3b99751d" returned: 0 in 0.355s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-6be12996-1a15-4e6c-8381-cc7a3b99751d" released by "delete_volume" :: held 1.225s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Created reservations ['cdb88f38-1abd-4c66-a4b7-369ddb370eaf', 'b3a32bbc-9d91-4215-946e-d4f618c236f4', '7f67fbe9-a1fe-4dc0-acbd-b19defb9cd0a', '4af01071-2614-4515-887e-1548bd6106f6'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:32 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:32 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:32 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.353s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:32 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Deleted volume successfully. Sep 07 09:49:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-97436491-fb18-41ae-a03f-679604c792c5 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-6be12996-1a15-4e6c-8381-cc7a3b99751d-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:33 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:49:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Flow 'volume_create_manager' (82602256-2b37-4cbf-9aa1-c5cd30af9100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed74140c-d3b5-4baf-9acb-a86e756d51e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed74140c-d3b5-4baf-9acb-a86e756d51e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-706388923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307ce57f-71f9-49fa-a097-0d1e53db87a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532f4571002c4ad6bbce4cf39715c490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:34Z,use_quota=True,user_id='24fb051eb68c43dd813b7ae3591d4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebad3a49-d87b-4e86-acf1-8c4b675874ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebad3a49-d87b-4e86-acf1-8c4b675874ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edee570-e534-492d-b042-9e1860ff490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edee570-e534-492d-b042-9e1860ff490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307ce57f-71f9-49fa-a097-0d1e53db87a5', 'volume_name': 'volume-307ce57f-71f9-49fa-a097-0d1e53db87a5', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868799f8-fb50-42ee-ada5-9430322432a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868799f8-fb50-42ee-ada5-9430322432a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e0c877-3de1-4be7-852c-4c3110dd97b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:34 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Volume 307ce57f-71f9-49fa-a097-0d1e53db87a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307ce57f-71f9-49fa-a097-0d1e53db87a5', 'volume_size': 1} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-706388923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307ce57f-71f9-49fa-a097-0d1e53db87a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532f4571002c4ad6bbce4cf39715c490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:34Z,use_quota=True,user_id='24fb051eb68c43dd813b7ae3591d4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Creating volume 307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:49:34 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:34 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 1073741824 Sep 07 09:49:34 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:34 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 1073741824" returned: 0 in 0.550s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:34 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 Sep 07 09:49:34 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:35 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5" returned: 0 in 0.334s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:49:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e0c877-3de1-4be7-852c-4c3110dd97b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307ce57f-71f9-49fa-a097-0d1e53db87a5', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21f5b51-b14c-4d10-bd54-f4d34f491d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Volume volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 (307ce57f-71f9-49fa-a097-0d1e53db87a5): created successfully Sep 07 09:49:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21f5b51-b14c-4d10-bd54-f4d34f491d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Flow 'volume_create_manager' (82602256-2b37-4cbf-9aa1-c5cd30af9100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b5b71095-dda0-46b7-8a24-e1d91c5b5f93 tempest-VolumesExtendTest-1508450639 None] Created volume successfully. Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Flow 'volume_create_manager' (bf61f197-66dc-4f44-b085-bc884e2cd52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba1dbb-868a-4ddc-918c-3bf73a365161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba1dbb-868a-4ddc-918c-3bf73a365161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1307667301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0e5db3f27442c199e0e3eeab5a24a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:37Z,use_quota=True,user_id='9351ce6ed40e42548524e54eff7b4c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931671d9-9c4f-4844-93fa-265c6a6a36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931671d9-9c4f-4844-93fa-265c6a6a36a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ccacbb-66e8-4601-bfcb-25c77ac0f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ccacbb-66e8-4601-bfcb-25c77ac0f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744', 'volume_name': 'volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e092ce2e-0af4-4cbe-bacc-c93244cff937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e092ce2e-0af4-4cbe-bacc-c93244cff937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8fc82c-1af4-4347-aa68-290a73ac2585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Volume 8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744', 'volume_size': 1} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Creating offline snapshot 99b72bf8-7dbf-4a64-9e4a-bbb143afd747 of volume 307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20173b-67e2-4689-a868-53fccefdbe4d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:37 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 Sep 07 09:49:37 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:37 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5" returned: 0 in 0.618s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:37 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 1G Sep 07 09:49:37 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:38 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 1G" returned: 0 in 0.669s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:38 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 Sep 07 09:49:38 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:38 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747" returned: 0 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:38 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 is being set with open permissions: ugo+rw Sep 07 09:49:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:38 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 Sep 07 09:49:38 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:38 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747" returned: 0 in 0.294s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:38 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=116,cinder:SELECT=102,cinder:INSERT=33,cinder:DELETE=6 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:49:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:39 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.info Sep 07 09:49:39 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:39 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.info" returned: 0 in 0.378s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:39 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.info is being set with open permissions: ugo+rw Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:39 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.info Sep 07 09:49:39 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:39 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.info" returned: 0 in 0.480s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.083s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.024s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1307667301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0e5db3f27442c199e0e3eeab5a24a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:37Z,use_quota=True,user_id='9351ce6ed40e42548524e54eff7b4c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Creating volume 8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:49:39 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:49:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:39 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 1073741824 Sep 07 09:49:39 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a2a01caa-7bee-4548-96c0-7fde922c0dbe tempest-VolumesExtendTest-1508450639 None] Create snapshot completed successfully Sep 07 09:49:40 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 1073741824" returned: 0 in 0.630s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:40 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 Sep 07 09:49:40 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:40 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" returned: 0 in 0.373s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8fc82c-1af4-4347-aa68-290a73ac2585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6f76d6-0d4e-4b02-895c-150126badf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Volume volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 (8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744): created successfully Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6f76d6-0d4e-4b02-895c-150126badf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Flow 'volume_create_manager' (bf61f197-66dc-4f44-b085-bc884e2cd52c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:41 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-61128e1c-1ab9-4cc0-ba56-68e7d3f0d1f3 tempest-VolumesCloneTest-599165646 None] Created volume successfully. Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea68b9-feb2-4b10-ac59-6c222e20e27e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:41 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:41 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:41 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 Sep 07 09:49:41 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:41 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.465s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:49:41 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5" returned: 0 in 0.531s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 2G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 2G" returned: 0 in 0.235s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.800s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d3f9c0d8-1d4f-4013-b352-602484ddd724 tempest-VolumesExtendTest-1508450639 None] Extend volume completed successfully. Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "cinder-99b72bf8-7dbf-4a64-9e4a-bbb143afd747-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-99b72bf8-7dbf-4a64-9e4a-bbb143afd747-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "cinder-quobyte-307ce57f-71f9-49fa-a097-0d1e53db87a5" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-307ce57f-71f9-49fa-a097-0d1e53db87a5" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "cinder-quobyte-99b72bf8-7dbf-4a64-9e4a-bbb143afd747" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-99b72bf8-7dbf-4a64-9e4a-bbb143afd747" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Deleting offline snapshot 99b72bf8-7dbf-4a64-9e4a-bbb143afd747 of volume 307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] snapshot_file for this snap is: volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5460c078-2129-4dfa-9150-f6a9e51c01fe]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:42 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 Sep 07 09:49:42 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Flow 'volume_create_manager' (f4ef507c-9bcd-406c-bc32-0512480dbb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef2cac2-cc6a-4585-8a9c-7ab921700d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef2cac2-cc6a-4585-8a9c-7ab921700d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-12662306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb57a6fd-1766-4ab9-a19b-e6e752c0860d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0e5db3f27442c199e0e3eeab5a24a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:49:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744,status='creating',terminated_at=None,updated_at=2026-09-07T07:49:43Z,use_quota=True,user_id='9351ce6ed40e42548524e54eff7b4c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68fb74f0-134b-455a-9e34-9c2134d44494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68fb74f0-134b-455a-9e34-9c2134d44494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be78b494-e02a-4fdb-8184-035145a98e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be78b494-e02a-4fdb-8184-035145a98e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bb57a6fd-1766-4ab9-a19b-e6e752c0860d', 'volume_name': 'volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d', 'volume_size': 2, 'source_volid': '8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744', 'source_volstatus': 'available'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b5c9be-efc5-4400-8983-c87876e8c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b5c9be-efc5-4400-8983-c87876e8c113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8d26d-f102-4e78-a0de-240efc149d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:42 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Volume bb57a6fd-1766-4ab9-a19b-e6e752c0860d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d', 'volume_size': 2, 'source_volid': '8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744', 'source_volstatus': 'available'} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:42 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Cloning volume 8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 to volume bb57a6fd-1766-4ab9-a19b-e6e752c0860d Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Creating offline snapshot 26af745c-602a-4010-8f75-72c06cbc3017 of volume 8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[232350cf-fb73-4ad0-8688-550ac0e7cbd0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:43 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747" returned: 0 in 0.471s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-307ce57f-71f9-49fa-a097-0d1e53db87a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b7a3c4-ce79-4bc5-acb5-cec8d5b62821]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:43 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 Sep 07 09:49:43 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:43 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 Sep 07 09:49:43 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:43 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" returned: 0 in 0.503s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:43 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 1G Sep 07 09:49:43 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:43 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5" returned: 0 in 0.625s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:43 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 Sep 07 09:49:43 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:44 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 1G" returned: 0 in 0.502s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:44 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 Sep 07 09:49:44 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:44 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747" returned: 0 in 0.442s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:44 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747 Sep 07 09:49:44 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:44 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017" returned: 0 in 0.371s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:44 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 is being set with open permissions: ugo+rw Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:44 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 Sep 07 09:49:44 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:44 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5.99b72bf8-7dbf-4a64-9e4a-bbb143afd747" returned: 0 in 0.329s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-99b72bf8-7dbf-4a64-9e4a-bbb143afd747" released by "_delete_snapshot" :: held 2.028s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-307ce57f-71f9-49fa-a097-0d1e53db87a5" released by "delete_snapshot" :: held 2.082s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Created reservations ['714ef90d-fcd5-413a-bae2-c279a30b8a7e', '25f7380f-1d82-4ebe-ab57-815e21f9dcef', '9752d613-06fd-441f-bd54-4404f086b807', 'd6e1f49d-8052-47da-a023-d7d9fda56799'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:44 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017" returned: 0 in 0.272s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Delete snapshot completed successfully. Sep 07 09:49:44 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.info Sep 07 09:49:44 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7ceda850-7f1a-44e2-a2da-64b39fa094a3 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-99b72bf8-7dbf-4a64-9e4a-bbb143afd747-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:45 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.info" returned: 0 in 0.314s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:45 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.info is being set with open permissions: ugo+rw Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:45 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.info Sep 07 09:49:45 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:45 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.info" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Acquiring lock "cinder-quobyte-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] snapshot: 26af745c-602a-4010-8f75-72c06cbc3017, volume: bb57a6fd-1766-4ab9-a19b-e6e752c0860d, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d4057-5434-49a8-a162-b924a4b18e19]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:45 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 Sep 07 09:49:45 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "cinder-307ce57f-71f9-49fa-a097-0d1e53db87a5-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-307ce57f-71f9-49fa-a097-0d1e53db87a5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:45 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017" returned: 0 in 0.490s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24a311a-f7cc-44d6-959a-9c17f71f0400]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "cinder-quobyte-307ce57f-71f9-49fa-a097-0d1e53db87a5" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-307ce57f-71f9-49fa-a097-0d1e53db87a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbca812-6e54-4bad-9a34-b5447bbd3252]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:46 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 Sep 07 09:49:46 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:46 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 Sep 07 09:49:46 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:46 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5" returned: 0 in 0.491s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:46 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5 Sep 07 09:49:46 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:46 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" returned: 0 in 0.689s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:49:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:46 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d Sep 07 09:49:46 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:47 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-307ce57f-71f9-49fa-a097-0d1e53db87a5" returned: 0 in 0.645s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-quobyte-307ce57f-71f9-49fa-a097-0d1e53db87a5" released by "delete_volume" :: held 1.212s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=120,cinder:INSERT=37,cinder:UPDATE=124,cinder:DELETE=13 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Created reservations ['4969886b-fb6a-47e9-b7f0-58b18448d977', '7d0eb6dd-f921-4063-8942-32d04883d233', '2fd6dbc3-d06e-450f-bb91-d4b3963e73d5', 'e434f3b8-1ff3-454d-a58e-fb5420b1f844'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:47 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:47 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:48 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 1.139s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:48 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Deleted volume successfully. Sep 07 09:49:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ff0aa2fe-01da-42ca-b404-7ad2912c0359 tempest-VolumesExtendTest-1508450639 None] Lock "cinder-307ce57f-71f9-49fa-a097-0d1e53db87a5-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:53 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" returned: 0 in 7.005s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:53 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:49:53 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Converted 1024.00 MB image at 146.17 MB/s Sep 07 09:49:53 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d is being set with open permissions: ugo+rw Sep 07 09:49:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:53 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d Sep 07 09:49:53 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:53 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" returned: 0 in 0.308s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" released by "_copy_volume_from_snapshot" :: held 8.587s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Acquiring lock "cinder-quobyte-26af745c-602a-4010-8f75-72c06cbc3017" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-26af745c-602a-4010-8f75-72c06cbc3017" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Deleting offline snapshot 26af745c-602a-4010-8f75-72c06cbc3017 of volume 8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] snapshot_file for this snap is: volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d4af48-0803-4d57-9049-277a4989003a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:54 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 Sep 07 09:49:54 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:54 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017" returned: 0 in 0.432s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70a110b-2574-4b67-bc8f-2e7728890bd6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:54 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 Sep 07 09:49:54 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:55 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" returned: 0 in 0.694s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:55 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 Sep 07 09:49:55 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:55 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017" returned: 0 in 0.462s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:55 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017 Sep 07 09:49:55 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:55 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744.26af745c-602a-4010-8f75-72c06cbc3017" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-26af745c-602a-4010-8f75-72c06cbc3017" released by "_delete_snapshot" :: held 1.992s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.065s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8d26d-f102-4e78-a0de-240efc149d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d', 'volume_size': 2, 'source_volid': '8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744', 'source_volstatus': 'available'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83368c87-2cf4-40b2-8ab9-8df7110f8a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:49:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Volume volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d (bb57a6fd-1766-4ab9-a19b-e6e752c0860d): created successfully Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83368c87-2cf4-40b2-8ab9-8df7110f8a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Flow 'volume_create_manager' (f4ef507c-9bcd-406c-bc32-0512480dbb1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:49:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ed6b8e40-a6b4-443c-829a-4d1834913ab7 tempest-VolumesCloneTest-599165646 None] Created volume successfully. Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Acquiring lock "cinder-bb57a6fd-1766-4ab9-a19b-e6e752c0860d-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Lock "cinder-bb57a6fd-1766-4ab9-a19b-e6e752c0860d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Acquiring lock "cinder-quobyte-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd832c2-07f5-46c5-8786-0908eb1c6a5a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:57 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d Sep 07 09:49:57 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:57 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" returned: 0 in 0.438s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:57 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d Sep 07 09:49:57 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:57 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" returned: 0 in 0.362s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-bb57a6fd-1766-4ab9-a19b-e6e752c0860d" released by "delete_volume" :: held 0.854s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Created reservations ['97002fae-b17c-49d9-adb6-1aaede179a9f', '3ac175d4-733a-4f97-a8f3-cec11dd0d70e', '66e1fe28-7a7f-4e89-9047-ecf0ad1e4abc', '42c528c9-7bcc-4f13-b17f-edc1ece742e2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:57 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:57 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Acquiring lock "cinder-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Lock "cinder-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:58 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.340s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Deleted volume successfully. Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Acquiring lock "cinder-quobyte-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-689d6947-b093-4b9e-90cf-d80eafe5fbd0 tempest-VolumesCloneTest-599165646 None] Lock "cinder-bb57a6fd-1766-4ab9-a19b-e6e752c0860d-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[27716030-cb11-4da0-87fe-8e036ca791fd]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:58 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 Sep 07 09:49:58 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:58 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" returned: 0 in 0.513s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:58 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744 Sep 07 09:49:58 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:59 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" returned: 0 in 0.329s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Lock "cinder-quobyte-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744" released by "delete_volume" :: held 0.957s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Created reservations ['ab8191b1-2ef2-4777-96ca-dce28e2020f9', 'b131df1a-ce54-4d2a-9879-a0deefc35ca2', '68581cd3-7510-4483-8d9c-40d9e324a267', '49ed86b0-1376-47a2-922e-34466f7b806c'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:49:59 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:49:59 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:49:59 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.336s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:49:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Deleted volume successfully. Sep 07 09:49:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dcbccf2-504f-442f-b688-d3c07254588a tempest-VolumesCloneTest-599165646 None] Lock "cinder-8d6d26ee-4ad2-482e-8f7d-2d7fea3c6744-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Flow 'volume_create_manager' (69488f56-d508-47f1-842a-ba063890f08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2091db79-7a11-4fe8-ae03-3b22b0b7f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2091db79-7a11-4fe8-ae03-3b22b0b7f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-555774780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37114973-0b30-4565-8530-7434e40d2925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad2f442d1154211b14dc0b0d7701ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:00Z,use_quota=True,user_id='8f1a5cb7e13b476b87f4f4ec8e00f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e7765a-d52e-4066-9136-a3bcb84cf7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e7765a-d52e-4066-9136-a3bcb84cf7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17348351-f433-4976-acd0-fbbecc9a5386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17348351-f433-4976-acd0-fbbecc9a5386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37114973-0b30-4565-8530-7434e40d2925', 'volume_name': 'volume-37114973-0b30-4565-8530-7434e40d2925', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70b0b84-9dd4-4adb-9dbb-a2e66e147c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70b0b84-9dd4-4adb-9dbb-a2e66e147c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83d0d0d-319f-4a27-abe4-9ccca2c881ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Volume 37114973-0b30-4565-8530-7434e40d2925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37114973-0b30-4565-8530-7434e40d2925', 'volume_size': 1} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-555774780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37114973-0b30-4565-8530-7434e40d2925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad2f442d1154211b14dc0b0d7701ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:00Z,use_quota=True,user_id='8f1a5cb7e13b476b87f4f4ec8e00f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Creating volume 37114973-0b30-4565-8530-7434e40d2925 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:50:00 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:00 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 1073741824 Sep 07 09:50:00 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Flow 'volume_create_manager' (20179a43-695e-45d7-ac9e-8a3cbf69cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda6fcd5-3655-409c-9f3c-d876b936a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda6fcd5-3655-409c-9f3c-d876b936a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-505262048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52034ad2-ded0-4154-831f-088c133557dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577d7d1f8bf4b32a569094a58165f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:01Z,use_quota=True,user_id='c11d4c72d9e24bee9936597109683264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637bc087-babb-4a57-9f99-9426743aa3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637bc087-babb-4a57-9f99-9426743aa3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a773e8dd-5686-4dab-8d50-6d9571d761b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a773e8dd-5686-4dab-8d50-6d9571d761b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52034ad2-ded0-4154-831f-088c133557dd', 'volume_name': 'volume-52034ad2-ded0-4154-831f-088c133557dd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6626e03-5bb7-4745-bfce-b28eac5e902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6626e03-5bb7-4745-bfce-b28eac5e902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9015bb08-c8aa-479e-b01b-ec961dea0822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:00 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Volume 52034ad2-ded0-4154-831f-088c133557dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52034ad2-ded0-4154-831f-088c133557dd', 'volume_size': 1} Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:00 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 1073741824" returned: 0 in 0.750s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:01 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 Sep 07 09:50:01 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:01 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.353s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-505262048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52034ad2-ded0-4154-831f-088c133557dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577d7d1f8bf4b32a569094a58165f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:01Z,use_quota=True,user_id='c11d4c72d9e24bee9936597109683264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Creating volume 52034ad2-ded0-4154-831f-088c133557dd {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:50:01 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83d0d0d-319f-4a27-abe4-9ccca2c881ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37114973-0b30-4565-8530-7434e40d2925', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:01 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd 1073741824 Sep 07 09:50:01 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dc6c63-3770-4637-89ca-3dbaf2482175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:01 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Volume volume-37114973-0b30-4565-8530-7434e40d2925 (37114973-0b30-4565-8530-7434e40d2925): created successfully Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dc6c63-3770-4637-89ca-3dbaf2482175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Flow 'volume_create_manager' (69488f56-d508-47f1-842a-ba063890f08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:01 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2cf6753c-0549-4799-9682-232fb7e6fde8 tempest-VolumesNegativeTest-639598962 None] Created volume successfully. Sep 07 09:50:02 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd 1073741824" returned: 0 in 0.698s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:02 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd Sep 07 09:50:02 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:02 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd" returned: 0 in 0.373s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9015bb08-c8aa-479e-b01b-ec961dea0822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52034ad2-ded0-4154-831f-088c133557dd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b31d223-ff61-453b-847e-6731a54279c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:02 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Volume volume-52034ad2-ded0-4154-831f-088c133557dd (52034ad2-ded0-4154-831f-088c133557dd): created successfully Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b31d223-ff61-453b-847e-6731a54279c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Flow 'volume_create_manager' (20179a43-695e-45d7-ac9e-8a3cbf69cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6119c02b-bc69-47d1-bdaf-e8acfacad1d0 tempest-AttachVolumeNegativeTest-1432735598 None] Created volume successfully. Sep 07 09:50:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-7e06292d-9f69-46b6-b04d-0ff299346baa req-4c2775a2-96bb-477f-bce6-65dff098fc99 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-7e06292d-9f69-46b6-b04d-0ff299346baa req-4c2775a2-96bb-477f-bce6-65dff098fc99 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-7e06292d-9f69-46b6-b04d-0ff299346baa req-4c2775a2-96bb-477f-bce6-65dff098fc99 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-7e06292d-9f69-46b6-b04d-0ff299346baa req-4c2775a2-96bb-477f-bce6-65dff098fc99 tempest-AttachVolumeNegativeTest-1432735598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-52034ad2-ded0-4154-831f-088c133557dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '053a498d-069e-4fee-84e5-4efda93639e9', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:50:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-7e06292d-9f69-46b6-b04d-0ff299346baa req-4c2775a2-96bb-477f-bce6-65dff098fc99 tempest-AttachVolumeNegativeTest-1432735598 None] attachment_update completed successfully. Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (effe9580-3120-404c-8044-716adbe7b529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f00266-2fe9-4e38-a41b-71c30328f00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f00266-2fe9-4e38-a41b-71c30328f00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949977516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914167c5-3054-4e90-b99f-6dc7862e4df5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:07Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e82564e-523e-4eb2-a074-baf5ab9d516b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e82564e-523e-4eb2-a074-baf5ab9d516b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c990216f-48cb-4f3a-895c-0edb5970b055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c990216f-48cb-4f3a-895c-0edb5970b055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914167c5-3054-4e90-b99f-6dc7862e4df5', 'volume_name': 'volume-914167c5-3054-4e90-b99f-6dc7862e4df5', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0707dee3-f60c-4ec1-94ba-f4ab3e895c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0707dee3-f60c-4ec1-94ba-f4ab3e895c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab725de-7c41-4baa-944b-30f2f8a57316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:07 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Volume 914167c5-3054-4e90-b99f-6dc7862e4df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914167c5-3054-4e90-b99f-6dc7862e4df5', 'volume_size': 1} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949977516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914167c5-3054-4e90-b99f-6dc7862e4df5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:07Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Creating volume 914167c5-3054-4e90-b99f-6dc7862e4df5 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:50:07 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:50:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:07 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 1073741824 Sep 07 09:50:07 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-8e751fd3-a3a7-4930-8b5f-6c38f47db20a req-3a6ec670-c6fe-468b-a301-5fef102487f8 tempest-AttachVolumeNegativeTest-1432735598 None] Terminate volume connection completed successfully. Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-8e751fd3-a3a7-4930-8b5f-6c38f47db20a req-3a6ec670-c6fe-468b-a301-5fef102487f8 tempest-AttachVolumeNegativeTest-1432735598 None] Deleting attachment 053a498d-069e-4fee-84e5-4efda93639e9. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:50:08 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 1073741824" returned: 0 in 0.889s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:08 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 Sep 07 09:50:08 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:08 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5" returned: 0 in 0.388s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab725de-7c41-4baa-944b-30f2f8a57316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914167c5-3054-4e90-b99f-6dc7862e4df5', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaab6953-53bd-4a17-871c-55627263c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Volume volume-914167c5-3054-4e90-b99f-6dc7862e4df5 (914167c5-3054-4e90-b99f-6dc7862e4df5): created successfully Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaab6953-53bd-4a17-871c-55627263c89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (effe9580-3120-404c-8044-716adbe7b529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a9415048-ffed-44aa-9d4a-8d43da694c44 tempest-VolumesGetTest-601498283 None] Created volume successfully. Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (43d6dd59-9466-4371-b07c-58e70ed892f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb3501d-f5ea-44ef-8c2a-d0bb5ddadbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb3501d-f5ea-44ef-8c2a-d0bb5ddadbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1832331009',display_name='tempest-VolumesGetTest-Volume-192920742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc0a044-b9a2-4e98-b9d2-22c27951ac70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:11Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339e581d-f045-4e34-8dc2-3deea31c0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339e581d-f045-4e34-8dc2-3deea31c0126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b837a1c6-3d58-4a57-9e38-fff88f131530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b837a1c6-3d58-4a57-9e38-fff88f131530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc0a044-b9a2-4e98-b9d2-22c27951ac70', 'volume_name': 'volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f34580-e3b1-4818-a3d2-b1b6d9556384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f34580-e3b1-4818-a3d2-b1b6d9556384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a35582-2cf2-49e6-8953-f5c899fcceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Volume dbc0a044-b9a2-4e98-b9d2-22c27951ac70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70', 'volume_size': 1} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1832331009',display_name='tempest-VolumesGetTest-Volume-192920742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc0a044-b9a2-4e98-b9d2-22c27951ac70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:11Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Creating volume dbc0a044-b9a2-4e98-b9d2-22c27951ac70 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:50:10 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:50:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:10 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 1073741824 Sep 07 09:50:10 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:11 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 1073741824" returned: 0 in 0.557s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:11 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 Sep 07 09:50:11 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:11 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70" returned: 0 in 0.316s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a35582-2cf2-49e6-8953-f5c899fcceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade9ca38-b62d-4707-84a3-3bd677896c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Volume volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 (dbc0a044-b9a2-4e98-b9d2-22c27951ac70): created successfully Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade9ca38-b62d-4707-84a3-3bd677896c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (43d6dd59-9466-4371-b07c-58e70ed892f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-557f6da0-1e3f-426c-8559-8a68531dd9a4 tempest-VolumesGetTest-601498283 None] Created volume successfully. Sep 07 09:50:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-dbc0a044-b9a2-4e98-b9d2-22c27951ac70-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Lock "cinder-dbc0a044-b9a2-4e98-b9d2-22c27951ac70-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-dbc0a044-b9a2-4e98-b9d2-22c27951ac70" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-dbc0a044-b9a2-4e98-b9d2-22c27951ac70" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2410b31b-dbab-4504-b393-8082079b9a8c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:13 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 Sep 07 09:50:13 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:14 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70" returned: 0 in 0.887s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:14 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70 Sep 07 09:50:14 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:14 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-dbc0a044-b9a2-4e98-b9d2-22c27951ac70" returned: 0 in 0.817s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-dbc0a044-b9a2-4e98-b9d2-22c27951ac70" released by "delete_volume" :: held 1.783s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Created reservations ['574b9587-8062-43cf-a62f-7dbe4d3a760a', 'e5ab0ec6-1f9f-4003-bd96-9b7d4b5aebf6', 'd87fbca7-d683-43ac-8c0f-b8793c33c54e', '6e3a7241-a194-449c-99ea-a5e31a4f90ab'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:15 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:50:15 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-914167c5-3054-4e90-b99f-6dc7862e4df5-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Lock "cinder-914167c5-3054-4e90-b99f-6dc7862e4df5-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-914167c5-3054-4e90-b99f-6dc7862e4df5" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-914167c5-3054-4e90-b99f-6dc7862e4df5" acquired by "delete_volume" :: waited 0.039s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:16 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.860s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:50:16 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Deleted volume successfully. Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f3a48-8d0c-42a3-bd13-718ebfddf24f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1d90b49d-bca9-47f4-9755-4361c5d476f0 tempest-VolumesGetTest-601498283 None] Lock "cinder-dbc0a044-b9a2-4e98-b9d2-22c27951ac70-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:16 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 Sep 07 09:50:16 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:17 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5" returned: 0 in 1.614s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:17 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5 Sep 07 09:50:17 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:18 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-914167c5-3054-4e90-b99f-6dc7862e4df5" returned: 0 in 0.525s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-914167c5-3054-4e90-b99f-6dc7862e4df5" released by "delete_volume" :: held 2.336s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Created reservations ['cf47e472-2509-40af-a042-abffc76a64a7', 'a6eb0042-233e-42de-849f-c503e8dbe500', '1d4d03e6-4eed-4891-9c5a-a7bcc8bab4ed', '77c48dae-3ce8-43ab-82d8-89c0b5ddcac4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:18 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:50:18 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:19 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.583s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:19 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:50:19 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Deleted volume successfully. Sep 07 09:50:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-befacc5f-b224-45ba-befb-2b60f01ea8f9 tempest-VolumesGetTest-601498283 None] Lock "cinder-914167c5-3054-4e90-b99f-6dc7862e4df5-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:20 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (dd1a7292-a155-4fe0-a77e-338fa5fac137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4116a42c-a1b5-4653-8845-bf7d3b9a9866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4116a42c-a1b5-4653-8845-bf7d3b9a9866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-524321979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832247da-3484-4939-8747-379646b23dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:21Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa3d700-7978-417a-b254-34af6da8d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa3d700-7978-417a-b254-34af6da8d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7374cecd-e6ab-467c-a332-adbfece4d84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7374cecd-e6ab-467c-a332-adbfece4d84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832247da-3484-4939-8747-379646b23dbc', 'volume_name': 'volume-832247da-3484-4939-8747-379646b23dbc', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cb7765-9507-462b-b205-903c6ed983f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cb7765-9507-462b-b205-903c6ed983f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa70bdd3-4ec5-4cc3-8c84-923174c03039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Volume 832247da-3484-4939-8747-379646b23dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832247da-3484-4939-8747-379646b23dbc', 'volume_size': 1} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-524321979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832247da-3484-4939-8747-379646b23dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:21Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Creating volume 832247da-3484-4939-8747-379646b23dbc {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:50:21 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:50:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:21 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc 1073741824 Sep 07 09:50:21 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:22 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc 1073741824" returned: 0 in 1.238s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:22 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc Sep 07 09:50:22 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:23 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc" returned: 0 in 0.945s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:50:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.297s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa70bdd3-4ec5-4cc3-8c84-923174c03039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832247da-3484-4939-8747-379646b23dbc', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff7a399-b6b2-4ab0-8a06-40e26c3f82eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Volume volume-832247da-3484-4939-8747-379646b23dbc (832247da-3484-4939-8747-379646b23dbc): created successfully Sep 07 09:50:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff7a399-b6b2-4ab0-8a06-40e26c3f82eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (dd1a7292-a155-4fe0-a77e-338fa5fac137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f02ae979-dd76-47fa-bcf4-d52c03237e9f tempest-VolumesGetTest-601498283 None] Created volume successfully. Sep 07 09:50:25 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (cb6958cd-324f-4661-ade2-d55e8ca01795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f71c3fd-a551-4bd8-843e-634b6e5cb371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f71c3fd-a551-4bd8-843e-634b6e5cb371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-279206429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c680cad4-c0b2-4074-8aeb-eaa6c49fce9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=832247da-3484-4939-8747-379646b23dbc,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:26Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69554d20-f1e6-4c16-bdd5-6a159b3c34f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69554d20-f1e6-4c16-bdd5-6a159b3c34f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ca9a2e-9582-46e7-955b-c41e42924da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ca9a2e-9582-46e7-955b-c41e42924da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c680cad4-c0b2-4074-8aeb-eaa6c49fce9d', 'volume_name': 'volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d', 'volume_size': 1, 'source_volid': '832247da-3484-4939-8747-379646b23dbc', 'source_volstatus': 'available'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1765de48-9be4-4b58-b84a-1b22f7ad0df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1765de48-9be4-4b58-b84a-1b22f7ad0df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e64b3d1-1bc9-401e-b263-f7b5abb09c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:26 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Volume c680cad4-c0b2-4074-8aeb-eaa6c49fce9d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d', 'volume_size': 1, 'source_volid': '832247da-3484-4939-8747-379646b23dbc', 'source_volstatus': 'available'} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:26 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Cloning volume 832247da-3484-4939-8747-379646b23dbc to volume c680cad4-c0b2-4074-8aeb-eaa6c49fce9d Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Creating offline snapshot 30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 of volume 832247da-3484-4939-8747-379646b23dbc {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bf89ba-28ad-454b-82b7-94defd2011f0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:26 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc Sep 07 09:50:26 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:26 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc" returned: 0 in 0.657s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:26 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 1G Sep 07 09:50:26 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 1G" returned: 0 in 0.700s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-832247da-3484-4939-8747-379646b23dbc -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:27 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:27 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-832247da-3484-4939-8747-379646b23dbc -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 Sep 07 09:50:27 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:28 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-832247da-3484-4939-8747-379646b23dbc -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" returned: 0 in 0.459s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:28 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 is being set with open permissions: ugo+rw Sep 07 09:50:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:28 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 Sep 07 09:50:28 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:28 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" returned: 0 in 0.618s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:28 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.info Sep 07 09:50:28 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:29 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.info" returned: 0 in 0.470s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:29 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.info is being set with open permissions: ugo+rw Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:29 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.info Sep 07 09:50:29 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:29 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.info" returned: 0 in 0.374s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] snapshot: 30bb338a-0741-4dc5-9c45-93e3ffe1b5d8, volume: c680cad4-c0b2-4074-8aeb-eaa6c49fce9d, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e00b4-d61b-4b05-acb6-f113e95c789a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:30 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 Sep 07 09:50:30 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:30 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" returned: 0 in 1.048s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-832247da-3484-4939-8747-379646b23dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:50:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b139dd-bee9-48ea-8008-106d98bbe846]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:31 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc Sep 07 09:50:31 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:32 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc" returned: 0 in 1.476s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:50:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:50:32 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:50:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:32 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d Sep 07 09:50:32 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Flow 'volume_create_manager' (815755f7-8928-45ee-8ecc-693755681207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af80e25d-e000-4899-9a04-532a3e9d6999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af80e25d-e000-4899-9a04-532a3e9d6999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1495688688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bd6818-0b9e-47c8-bc40-2297b3b31799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8602522750c42af9543245e9e274912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:33Z,use_quota=True,user_id='2e3761fb7c844903ae7ab91b9e190340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70eca1d-3147-4df2-ad27-afe081a9ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70eca1d-3147-4df2-ad27-afe081a9ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8556e471-7df9-4f38-bd56-0f59c10abc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8556e471-7df9-4f38-bd56-0f59c10abc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bd6818-0b9e-47c8-bc40-2297b3b31799', 'volume_name': 'volume-76bd6818-0b9e-47c8-bc40-2297b3b31799', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be4b5b3-c2f9-470e-a13c-ef519f3d716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be4b5b3-c2f9-470e-a13c-ef519f3d716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a479606f-3988-4e15-8526-dd8cc64695f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:33 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Volume 76bd6818-0b9e-47c8-bc40-2297b3b31799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bd6818-0b9e-47c8-bc40-2297b3b31799', 'volume_size': 1} Sep 07 09:50:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:40 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" returned: 0 in 7.947s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:50:40 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Converted 1024.00 MB image at 128.85 MB/s Sep 07 09:50:40 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d is being set with open permissions: ugo+rw Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:40 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d Sep 07 09:50:40 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:40 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" returned: 0 in 0.466s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" released by "_copy_volume_from_snapshot" :: held 11.081s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Deleting offline snapshot 30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 of volume 832247da-3484-4939-8747-379646b23dbc {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] snapshot_file for this snap is: volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4393fd5-6c7c-4893-9308-2bc52dee988f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:41 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:50:41 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:41 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 Sep 07 09:50:41 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:42 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.868s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:50:42 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" returned: 0 in 1.105s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-832247da-3484-4939-8747-379646b23dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac67f8f-397c-40b7-ba0a-44bb197d868b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:42 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc Sep 07 09:50:42 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:43 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=64,cinder:UPDATE=70,cinder:DELETE=10,cinder:INSERT=20 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:50:44 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc" returned: 0 in 1.964s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:44 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 Sep 07 09:50:44 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:44 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" returned: 0 in 0.726s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:44 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8 Sep 07 09:50:44 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:45 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc.30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" returned: 0 in 0.402s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-30bb338a-0741-4dc5-9c45-93e3ffe1b5d8" released by "_delete_snapshot" :: held 4.412s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.362s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.987s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1495688688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bd6818-0b9e-47c8-bc40-2297b3b31799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8602522750c42af9543245e9e274912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:33Z,use_quota=True,user_id='2e3761fb7c844903ae7ab91b9e190340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Creating volume 76bd6818-0b9e-47c8-bc40-2297b3b31799 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:50:45 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:45 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 1073741824 Sep 07 09:50:45 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Acquiring lock "cinder-37114973-0b30-4565-8530-7434e40d2925-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e64b3d1-1bc9-401e-b263-f7b5abb09c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d', 'volume_size': 1, 'source_volid': '832247da-3484-4939-8747-379646b23dbc', 'source_volstatus': 'available'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c245f6fe-7a81-40b2-a79b-a95d382659f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Lock "cinder-37114973-0b30-4565-8530-7434e40d2925-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:45 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Volume volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d (c680cad4-c0b2-4074-8aeb-eaa6c49fce9d): created successfully Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c245f6fe-7a81-40b2-a79b-a95d382659f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (cb6958cd-324f-4661-ade2-d55e8ca01795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-736ecdd2-e155-49d8-a8d4-c3ba57291508 tempest-VolumesGetTest-601498283 None] Created volume successfully. Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Acquiring lock "cinder-quobyte-37114973-0b30-4565-8530-7434e40d2925" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Lock "cinder-quobyte-37114973-0b30-4565-8530-7434e40d2925" acquired by "delete_volume" :: waited 0.032s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c1713f-84b2-4e7e-970b-ca917bb56283]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:45 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 Sep 07 09:50:45 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:46 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 1073741824" returned: 0 in 0.610s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:46 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 Sep 07 09:50:46 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:46 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925" returned: 0 in 0.495s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:46 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925 Sep 07 09:50:46 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:46 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799" returned: 0 in 0.306s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a479606f-3988-4e15-8526-dd8cc64695f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bd6818-0b9e-47c8-bc40-2297b3b31799', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85589caa-f263-42f4-b37d-74e4f8684746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:46 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Volume volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 (76bd6818-0b9e-47c8-bc40-2297b3b31799): created successfully Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85589caa-f263-42f4-b37d-74e4f8684746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Flow 'volume_create_manager' (815755f7-8928-45ee-8ecc-693755681207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c0df5ea9-bd36-4f80-90f1-f29fe39b9da8 tempest-ServerRescueNegativeTestJSON-1832136170 None] Created volume successfully. Sep 07 09:50:46 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37114973-0b30-4565-8530-7434e40d2925" returned: 0 in 0.332s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Lock "cinder-quobyte-37114973-0b30-4565-8530-7434e40d2925" released by "delete_volume" :: held 0.884s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Created reservations ['bb64a5e8-537e-44b1-ada4-125509dcc2d0', '3baa0ba4-ec56-4552-a8f3-f3c8e050ebf7', 'e632e3ae-3e3e-4521-9bbc-565d2cf0c24a', 'd24a33f2-9aee-4b76-a61b-d53d9d35b252'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:46 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:50:46 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:47 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:47 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:50:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Deleted volume successfully. Sep 07 09:50:47 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:INSERT=15,cinder:UPDATE=77,cinder:SELECT=51,cinder:DELETE=5 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:50:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-01776a76-c3fd-4319-b426-56e5db89b27e tempest-VolumesNegativeTest-639598962 None] Lock "cinder-37114973-0b30-4565-8530-7434e40d2925-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:47 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (a7bf7e07-ed44-434c-b927-7c72443a6719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247fadb9-3cce-4864-800b-010214eec0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247fadb9-3cce-4864-800b-010214eec0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-522810734',display_name='tempest-VolumesGetTest-Volume-1250204175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85012851-84c1-4d70-8a69-d6279e932137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:48Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e6712-0bcb-4bb1-aae3-c18f2b041e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e6712-0bcb-4bb1-aae3-c18f2b041e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f070ae32-dda4-4458-aac6-5eed48569357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f070ae32-dda4-4458-aac6-5eed48569357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85012851-84c1-4d70-8a69-d6279e932137', 'volume_name': 'volume-85012851-84c1-4d70-8a69-d6279e932137', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be72553-b247-4d2b-905f-7e31482b8d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be72553-b247-4d2b-905f-7e31482b8d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7764efcf-07c6-4028-a2e3-2a9649a9099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:48 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Volume 85012851-84c1-4d70-8a69-d6279e932137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85012851-84c1-4d70-8a69-d6279e932137', 'volume_size': 1} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-522810734',display_name='tempest-VolumesGetTest-Volume-1250204175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85012851-84c1-4d70-8a69-d6279e932137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:50:48Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Creating volume 85012851-84c1-4d70-8a69-d6279e932137 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:50:48 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:48 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 1073741824 Sep 07 09:50:48 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:48 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 1073741824" returned: 0 in 0.748s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:49 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 Sep 07 09:50:49 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:49 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137" returned: 0 in 0.522s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:50:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7764efcf-07c6-4028-a2e3-2a9649a9099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85012851-84c1-4d70-8a69-d6279e932137', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb4f594-21da-4d28-b03b-da29154b212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:49 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Volume volume-85012851-84c1-4d70-8a69-d6279e932137 (85012851-84c1-4d70-8a69-d6279e932137): created successfully Sep 07 09:50:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb4f594-21da-4d28-b03b-da29154b212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (a7bf7e07-ed44-434c-b927-7c72443a6719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:49 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ac28002c-ed48-44a9-bde0-facb73f76f74 tempest-VolumesGetTest-601498283 None] Created volume successfully. Sep 07 09:50:50 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-85012851-84c1-4d70-8a69-d6279e932137-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:50 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Lock "cinder-85012851-84c1-4d70-8a69-d6279e932137-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:50 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-85012851-84c1-4d70-8a69-d6279e932137" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:50 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-85012851-84c1-4d70-8a69-d6279e932137" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:50 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a206bb7-f366-483b-b239-9a16d3d9b2b0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:51 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 Sep 07 09:50:51 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:51 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137" returned: 0 in 0.766s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:51 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137 Sep 07 09:50:51 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:52 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-85012851-84c1-4d70-8a69-d6279e932137" returned: 0 in 0.528s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-85012851-84c1-4d70-8a69-d6279e932137" released by "delete_volume" :: held 1.388s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Created reservations ['90227b03-0408-4164-a1a1-f732f50b597e', 'ab2fab12-c5a2-4987-99b1-2135fe7728a0', '070b8641-5715-4256-b906-f0dfcb12e34f', '6aff5d5b-e6bb-435a-bfba-56d72e1cb093'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:52 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:50:52 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:52 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.424s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:52 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:50:53 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Deleted volume successfully. Sep 07 09:50:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cbf589e4-1c73-4be9-8094-164ae325666c tempest-VolumesGetTest-601498283 None] Lock "cinder-85012851-84c1-4d70-8a69-d6279e932137-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Lock "cinder-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:53 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c731df86-4ff0-4370-8594-e261c5626c4c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:53 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d Sep 07 09:50:53 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:54 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" returned: 0 in 0.502s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:54 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d Sep 07 09:50:54 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:54 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" returned: 0 in 0.562s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d" released by "delete_volume" :: held 1.160s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:54 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Created reservations ['9c343ddf-f6cd-464c-bafe-bf4f0a833b77', '77d40cb5-bf60-4a40-b321-1e71add69b8e', '9864673e-da8d-4103-98b4-cd1ea266a6c4', 'ead1a0e5-2c06-452f-b14f-34f0e51a7596'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:55 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:50:55 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:55 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.486s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:50:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Deleted volume successfully. Sep 07 09:50:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9eb6a951-c2fb-42e9-966e-cb8b3b766b5b tempest-VolumesGetTest-601498283 None] Lock "cinder-c680cad4-c0b2-4074-8aeb-eaa6c49fce9d-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-832247da-3484-4939-8747-379646b23dbc-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Lock "cinder-832247da-3484-4939-8747-379646b23dbc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-832247da-3484-4939-8747-379646b23dbc" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:50:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-832247da-3484-4939-8747-379646b23dbc" acquired by "delete_volume" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:50:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2555bccd-b826-4d52-a2f3-a2dd0b2c5334]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:50:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:56 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc Sep 07 09:50:56 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:57 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc" returned: 0 in 0.629s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:57 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc Sep 07 09:50:57 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:57 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-832247da-3484-4939-8747-379646b23dbc" returned: 0 in 0.425s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-832247da-3484-4939-8747-379646b23dbc" released by "delete_volume" :: held 1.163s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Created reservations ['7fd81553-6f6e-4708-8ea2-a605d346d8eb', '1c661b8b-2825-437e-9315-2366c1b96fa4', 'bd2cc1fc-5d9e-4ad8-8be5-b8c1211d9cb6', 'ba140a96-fe2a-41a9-9d5f-5b5ab63773cb'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:50:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:50:57 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:50:57 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:50:58 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 07 09:50:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.391s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:50:58 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:50:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Deleted volume successfully. Sep 07 09:50:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3e22421b-7e20-47be-9565-794a7e562427 tempest-VolumesGetTest-601498283 None] Lock "cinder-832247da-3484-4939-8747-379646b23dbc-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (15bd19d9-7809-43b0-a00e-9db5eb457ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fc8183-884a-4f5c-b59d-3171e858be44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fc8183-884a-4f5c-b59d-3171e858be44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1924517049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6b5e01-9117-4bbb-a1a9-50ff941be20b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:00Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f70466b-3282-4f89-8289-26051f95e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f70466b-3282-4f89-8289-26051f95e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b53cfc3-733b-43bb-8ecc-30bca4894c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:50:59 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Acquiring lock "cinder-76bd6818-0b9e-47c8-bc40-2297b3b31799-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "cinder-76bd6818-0b9e-47c8-bc40-2297b3b31799-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Acquiring lock "cinder-quobyte-76bd6818-0b9e-47c8-bc40-2297b3b31799" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "cinder-quobyte-76bd6818-0b9e-47c8-bc40-2297b3b31799" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c97b17-9328-46d5-b72a-fa73f5058f26]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b53cfc3-733b-43bb-8ecc-30bca4894c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c6b5e01-9117-4bbb-a1a9-50ff941be20b', 'volume_name': 'volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba9bc15-383c-4bde-b905-607aa52e47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba9bc15-383c-4bde-b905-607aa52e47ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fff56a-6ddb-40e3-b1d6-c1941b12a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:00 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Volume 2c6b5e01-9117-4bbb-a1a9-50ff941be20b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 09:51:00 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Trying to clone 2c6b5e01-9117-4bbb-a1a9-50ff941be20b from image 262465d0-5b79-4e49-bcf9-a496a478d70a at location (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 09:51:00 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 Sep 07 09:51:00 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 09:51:01 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Image download 20.69 MB at 20.69 MB/s Sep 07 09:51:01 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799" returned: 0 in 0.690s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a729880e-bda5-4023-b891-6b05e4e30afe]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:01 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799 Sep 07 09:51:01 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:01 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD Sep 07 09:51:01 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:01 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-76bd6818-0b9e-47c8-bc40-2297b3b31799" returned: 0 in 0.511s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "cinder-quobyte-76bd6818-0b9e-47c8-bc40-2297b3b31799" released by "delete_volume" :: held 1.267s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Created reservations ['586b0c7e-28c4-453b-8519-6b0cf078b71a', '25479023-49b2-4a6a-9aec-dcb5987c5e04', 'ac5c8715-ca68-4f06-9064-61ffd1ec5d62', '048ec9fe-a1d0-4455-a75c-7933cdc31626'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:01 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a is fetched for user cc7f3aff13dd4e2b9fdd1579c4d2028a. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:01 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:01 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bbdce0-4c5c-4302-a32c-d820c3e2369d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:02 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD Sep 07 09:51:02 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:02 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.401s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Deleted volume successfully. Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb948a8d-5836-462a-8f84-06b042866137 tempest-ServerRescueNegativeTestJSON-1832136170 None] Lock "cinder-76bd6818-0b9e-47c8-bc40-2297b3b31799-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:02 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1924517049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6b5e01-9117-4bbb-a1a9-50ff941be20b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:00Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Creating volume 2c6b5e01-9117-4bbb-a1a9-50ff941be20b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:02 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:02 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b 1073741824 Sep 07 09:51:02 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:03 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b 1073741824" returned: 0 in 0.725s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:03 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b Sep 07 09:51:03 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:03 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b" returned: 0 in 0.441s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Attempting download of 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 2c6b5e01-9117-4bbb-a1a9-50ff941be20b. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[93340a5b-0919-482f-8c0c-aa6a6539b6c3]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_6c96x0rs {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:03 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_6c96x0rs Sep 07 09:51:03 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:04 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_6c96x0rs" returned: 0 in 0.473s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_6c96x0rs {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:04 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_6c96x0rs Sep 07 09:51:04 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:04 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_6c96x0rs" returned: 1 in 0.683s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_6c96x0rs' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:51:04 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4501a0c-f869-4e30-b5a4-b1c32150077a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:05 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD Sep 07 09:51:05 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:05 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:05 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] 262465d0-5b79-4e49-bcf9-a496a478d70a was qcow2, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 09:51:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:05 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b Sep 07 09:51:05 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:08 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b" returned: 0 in 2.997s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:08 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_vb8ydcqgdevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:51:08 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Converted 112.00 MB image at 37.36 MB/s Sep 07 09:51:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:08 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b 1G Sep 07 09:51:08 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:09 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b 1G" returned: 0 in 0.652s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Downloaded image 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 2c6b5e01-9117-4bbb-a1a9-50ff941be20b successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a for user cc7f3aff13dd4e2b9fdd1579c4d2028a is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Marking volume 2c6b5e01-9117-4bbb-a1a9-50ff941be20b as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Copying metadata from image 262465d0-5b79-4e49-bcf9-a496a478d70a to 2c6b5e01-9117-4bbb-a1a9-50ff941be20b. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Creating volume glance metadata for volume 2c6b5e01-9117-4bbb-a1a9-50ff941be20b backed by image 262465d0-5b79-4e49-bcf9-a496a478d70a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fff56a-6ddb-40e3-b1d6-c1941b12a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2f18c4-0b00-4aec-94ff-059c9d816d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Volume volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b (2c6b5e01-9117-4bbb-a1a9-50ff941be20b): created successfully Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2f18c4-0b00-4aec-94ff-059c9d816d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (15bd19d9-7809-43b0-a00e-9db5eb457ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3bf1491f-92c0-40a0-81d2-65a5a1d6548e tempest-VolumesGetTest-601498283 None] Created volume successfully. Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (9fd759ed-11fa-4b24-9897-d000b9bfc9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca1236d-8734-4052-9359-15f3c5fe6a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca1236d-8734-4052-9359-15f3c5fe6a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1500378378',display_name='tempest-VolumesGetTest-Volume-2049228791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:11Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3108fe1-cd33-4a29-8b0f-f09d72a93bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3108fe1-cd33-4a29-8b0f-f09d72a93bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c9e3b1-54e4-4dcf-b9ee-9818ed291714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c9e3b1-54e4-4dcf-b9ee-9818ed291714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c', 'volume_name': 'volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09de09c-a127-42d9-9310-3c67c00e8a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09de09c-a127-42d9-9310-3c67c00e8a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fae86c1-1482-4f7f-9a14-93f44ae56acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Volume a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c', 'volume_size': 1} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1500378378',display_name='tempest-VolumesGetTest-Volume-2049228791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0d348dfae54c7e82883160bf026082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:11Z,use_quota=True,user_id='cc7f3aff13dd4e2b9fdd1579c4d2028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Creating volume a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:10 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:11 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c 1073741824 Sep 07 09:51:11 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:11 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c 1073741824" returned: 0 in 0.496s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:11 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c Sep 07 09:51:11 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:11 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c" returned: 0 in 0.322s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fae86c1-1482-4f7f-9a14-93f44ae56acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae343d-842a-44c9-963a-cfb53a417257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Volume volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c (a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c): created successfully Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae343d-842a-44c9-963a-cfb53a417257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Flow 'volume_create_manager' (9fd759ed-11fa-4b24-9897-d000b9bfc9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e46d4860-3131-4fad-8bdb-f82e77688624 tempest-VolumesGetTest-601498283 None] Created volume successfully. Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (9840be0a-f6e0-4559-904e-96cd6b0850de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1c0f6-5a62-4ed9-b66a-6b35d8ac89dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1c0f6-5a62-4ed9-b66a-6b35d8ac89dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1029125093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c30170-916b-40b4-ba8a-5c4896a59fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:12Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab29bc88-6647-4bdf-971b-22dd43d46fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab29bc88-6647-4bdf-971b-22dd43d46fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1027c883-c76e-4a53-9841-02eb187b79e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1027c883-c76e-4a53-9841-02eb187b79e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c30170-916b-40b4-ba8a-5c4896a59fbd', 'volume_name': 'volume-71c30170-916b-40b4-ba8a-5c4896a59fbd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe25fb1-26db-47fa-9868-27250d80aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe25fb1-26db-47fa-9868-27250d80aca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8670019f-3578-4136-870d-0cf1070592c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume 71c30170-916b-40b4-ba8a-5c4896a59fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c30170-916b-40b4-ba8a-5c4896a59fbd', 'volume_size': 1} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1029125093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c30170-916b-40b4-ba8a-5c4896a59fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:12Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Creating volume 71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:12 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:12 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd 1073741824 Sep 07 09:51:12 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Flow 'volume_create_manager' (51597760-a0e0-4644-b5f8-6b3f38676c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da72af4e-1f5f-482b-9f88-00e71bbcec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da72af4e-1f5f-482b-9f88-00e71bbcec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1151904943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77644d46-365c-4aed-a19a-6409030cea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577d7d1f8bf4b32a569094a58165f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:12Z,use_quota=True,user_id='c11d4c72d9e24bee9936597109683264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fa09e0-bd08-4e11-8bb4-ad7cadc4bd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fa09e0-bd08-4e11-8bb4-ad7cadc4bd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a1e040-40dd-4990-b880-797f21cb32bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a1e040-40dd-4990-b880-797f21cb32bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77644d46-365c-4aed-a19a-6409030cea95', 'volume_name': 'volume-77644d46-365c-4aed-a19a-6409030cea95', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2b54b5-7cae-4e08-a05f-77e4f0604a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2b54b5-7cae-4e08-a05f-77e4f0604a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e14d95-4ad4-4e8b-8f2d-6781bb62706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Volume 77644d46-365c-4aed-a19a-6409030cea95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77644d46-365c-4aed-a19a-6409030cea95', 'volume_size': 1} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:12 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd 1073741824" returned: 0 in 0.436s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:12 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd Sep 07 09:51:12 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:12 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd" returned: 0 in 0.257s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1151904943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77644d46-365c-4aed-a19a-6409030cea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577d7d1f8bf4b32a569094a58165f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:12Z,use_quota=True,user_id='c11d4c72d9e24bee9936597109683264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Creating volume 77644d46-365c-4aed-a19a-6409030cea95 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:12 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8670019f-3578-4136-870d-0cf1070592c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c30170-916b-40b4-ba8a-5c4896a59fbd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 1073741824 Sep 07 09:51:12 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6e4846-5d96-488f-ac53-db626ad7168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume volume-71c30170-916b-40b4-ba8a-5c4896a59fbd (71c30170-916b-40b4-ba8a-5c4896a59fbd): created successfully Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6e4846-5d96-488f-ac53-db626ad7168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (9840be0a-f6e0-4559-904e-96cd6b0850de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b6f4176b-21e3-46f3-ade6-e934109b92a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Created volume successfully. Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Lock "cinder-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e0d97f-6d21-467e-a64d-3f608d0d4929]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:13 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 1073741824" returned: 0 in 0.508s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:13 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c Sep 07 09:51:13 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:13 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 Sep 07 09:51:13 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:13 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95" returned: 0 in 0.262s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e14d95-4ad4-4e8b-8f2d-6781bb62706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77644d46-365c-4aed-a19a-6409030cea95', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f580e2-10f3-403d-8b06-23cb4570b205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:13 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c" returned: 0 in 0.433s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Volume volume-77644d46-365c-4aed-a19a-6409030cea95 (77644d46-365c-4aed-a19a-6409030cea95): created successfully Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f580e2-10f3-403d-8b06-23cb4570b205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:13 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c Sep 07 09:51:13 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Flow 'volume_create_manager' (51597760-a0e0-4644-b5f8-6b3f38676c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0977ad05-10a8-4da3-9c5c-2c5963df0cde tempest-AttachVolumeNegativeTest-1432735598 None] Created volume successfully. Sep 07 09:51:14 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c" returned: 0 in 0.343s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c" released by "delete_volume" :: held 0.848s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Created reservations ['36e6f9fd-8494-4485-a361-9828a1a97e43', '7d5a5d9a-497d-4681-b3b2-4c3323bf4ce5', '20a4da56-192f-48f7-af15-fb0732b24bb0', '5dd17db7-e32a-496c-891c-f014969fb864'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:14 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:14 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Creating offline snapshot 9ab7cf35-b59e-4120-aaa3-335f8419aad9 of volume 71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce43ed2-6b4e-481b-b930-3277091279c9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:14 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.395s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Deleted volume successfully. Sep 07 09:51:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13dbda4c-469f-4880-906b-b5a8bd929e4b tempest-VolumesGetTest-601498283 None] Lock "cinder-a81eabc5-0b40-4fd5-b8e4-dbaa7e03382c-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:14 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd Sep 07 09:51:14 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-5e7f928d-71aa-4b2b-9808-88e460242189 req-2ee99151-6be6-48dd-a13b-046410dfaf58 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:15 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd" returned: 0 in 0.497s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:15 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 1G Sep 07 09:51:15 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-2c6b5e01-9117-4bbb-a1a9-50ff941be20b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Lock "cinder-2c6b5e01-9117-4bbb-a1a9-50ff941be20b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Acquiring lock "cinder-quobyte-2c6b5e01-9117-4bbb-a1a9-50ff941be20b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-2c6b5e01-9117-4bbb-a1a9-50ff941be20b" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a53920-3a5f-45a3-926c-461bbc17289b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:15 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 1G" returned: 0 in 0.610s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71c30170-916b-40b4-ba8a-5c4896a59fbd -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:15 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71c30170-916b-40b4-ba8a-5c4896a59fbd -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 Sep 07 09:51:15 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:15 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b Sep 07 09:51:15 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:16 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b" returned: 0 in 0.389s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:16 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71c30170-916b-40b4-ba8a-5c4896a59fbd -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9" returned: 0 in 0.335s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:16 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 is being set with open permissions: ugo+rw Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:16 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b Sep 07 09:51:16 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:16 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 Sep 07 09:51:16 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:16 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c6b5e01-9117-4bbb-a1a9-50ff941be20b" returned: 0 in 0.295s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Lock "cinder-quobyte-2c6b5e01-9117-4bbb-a1a9-50ff941be20b" released by "delete_volume" :: held 0.742s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:16 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9" returned: 0 in 0.316s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Created reservations ['ae600588-ddab-4b8d-8d59-cd8c0bb3c766', '7f91aa82-ead8-4bd5-ab53-4b563423cfc0', '5d5a01df-8da0-4aba-b761-9badd93a7a7e', '43cc8b4f-1e02-4bdd-99d1-0a8dccd58521'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:16 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.info Sep 07 09:51:16 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:16 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:16 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:16 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.info" returned: 0 in 0.367s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:16 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.info is being set with open permissions: ugo+rw Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:16 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.info Sep 07 09:51:16 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:16 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.343s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:17 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Deleted volume successfully. Sep 07 09:51:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fc97603b-874c-4558-9809-30c97e82e52d tempest-VolumesGetTest-601498283 None] Lock "cinder-2c6b5e01-9117-4bbb-a1a9-50ff941be20b-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:17 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.info" returned: 0 in 0.304s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-5e7f928d-71aa-4b2b-9808-88e460242189 req-2ee99151-6be6-48dd-a13b-046410dfaf58 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.081s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-5e7f928d-71aa-4b2b-9808-88e460242189 req-2ee99151-6be6-48dd-a13b-046410dfaf58 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-5e7f928d-71aa-4b2b-9808-88e460242189 req-2ee99151-6be6-48dd-a13b-046410dfaf58 tempest-AttachVolumeNegativeTest-1432735598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-77644d46-365c-4aed-a19a-6409030cea95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3649ea93-ecbd-43e8-8594-9c75051ec2c7', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:51:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-da9f3d6e-93e0-496f-b221-68fa9c7657de tempest-VolumesSnapshotTestJSON-1049942510 None] Create snapshot completed successfully Sep 07 09:51:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-5e7f928d-71aa-4b2b-9808-88e460242189 req-2ee99151-6be6-48dd-a13b-046410dfaf58 tempest-AttachVolumeNegativeTest-1432735598 None] attachment_update completed successfully. Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-9ab7cf35-b59e-4120-aaa3-335f8419aad9-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-9ab7cf35-b59e-4120-aaa3-335f8419aad9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-71c30170-916b-40b4-ba8a-5c4896a59fbd" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-71c30170-916b-40b4-ba8a-5c4896a59fbd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-9ab7cf35-b59e-4120-aaa3-335f8419aad9" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-9ab7cf35-b59e-4120-aaa3-335f8419aad9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Deleting offline snapshot 9ab7cf35-b59e-4120-aaa3-335f8419aad9 of volume 71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] snapshot_file for this snap is: volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ef130-07a6-41aa-a5a0-1b94cf324754]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:18 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 Sep 07 09:51:18 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:18 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9" returned: 0 in 0.470s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71c30170-916b-40b4-ba8a-5c4896a59fbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca7999-e36f-4d2e-8eee-2b5c8266a551]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:18 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd Sep 07 09:51:18 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:19 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd" returned: 0 in 0.442s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:19 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 Sep 07 09:51:19 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:19 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9" returned: 0 in 0.509s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:19 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9 Sep 07 09:51:19 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:20 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd.9ab7cf35-b59e-4120-aaa3-335f8419aad9" returned: 0 in 0.380s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-9ab7cf35-b59e-4120-aaa3-335f8419aad9" released by "_delete_snapshot" :: held 1.950s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-71c30170-916b-40b4-ba8a-5c4896a59fbd" released by "delete_snapshot" :: held 1.985s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:20 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['657125e6-4602-4e2e-a249-95179e31c59c', '9c93af5a-7dd9-40e7-8f7f-3ba252a912a8', 'a408a8c8-2d49-48d4-b005-9d94dd9fb0c7', '5294713e-9aaf-4d15-a1c1-973d62530d0f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Delete snapshot completed successfully. Sep 07 09:51:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fb734bc-25a8-4356-8fc2-f1b86cf6386a tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-9ab7cf35-b59e-4120-aaa3-335f8419aad9-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-e486091c-40d0-424a-89ab-cc4ba764df62 req-d3fd13ae-5516-43dd-b71d-eefdee6f1632 tempest-AttachVolumeNegativeTest-1432735598 None] Terminate volume connection completed successfully. Sep 07 09:51:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-e486091c-40d0-424a-89ab-cc4ba764df62 req-d3fd13ae-5516-43dd-b71d-eefdee6f1632 tempest-AttachVolumeNegativeTest-1432735598 None] Deleting attachment 3649ea93-ecbd-43e8-8594-9c75051ec2c7. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (4e3afe6e-d684-4261-ba0b-b18764f91f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9a7d93-c360-486f-b0cc-27ce3534a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9a7d93-c360-486f-b0cc-27ce3534a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-61315541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab89f27e-3827-497a-9a49-cd69eaeeca23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:22Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a87f4d-ab73-436d-8004-e952ff57291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a87f4d-ab73-436d-8004-e952ff57291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177b03df-958f-4fe7-81eb-1c2c13d00f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177b03df-958f-4fe7-81eb-1c2c13d00f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab89f27e-3827-497a-9a49-cd69eaeeca23', 'volume_name': 'volume-ab89f27e-3827-497a-9a49-cd69eaeeca23', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34e12f0-f25a-46fd-8bfc-344efbd65673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34e12f0-f25a-46fd-8bfc-344efbd65673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a693f42-db87-4550-b577-23108e0b0bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume ab89f27e-3827-497a-9a49-cd69eaeeca23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab89f27e-3827-497a-9a49-cd69eaeeca23', 'volume_size': 1} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-61315541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab89f27e-3827-497a-9a49-cd69eaeeca23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:22Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Creating volume ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:22 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:22 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 1073741824 Sep 07 09:51:22 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Flow 'volume_create_manager' (5dc7fe1d-6d7d-483a-86ac-c580fd891533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76afcb50-d0cb-433f-8081-147163a7bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76afcb50-d0cb-433f-8081-147163a7bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-116977847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eea215b-febb-4397-8563-8f0e31917b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275453152ec942238ef4c785c7d6996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:23Z,use_quota=True,user_id='4f6549b5817f4ecaaad2c251a7024840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cce90b2-5055-420d-a7ae-e9c107b1c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cce90b2-5055-420d-a7ae-e9c107b1c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c8f206-a93a-4722-aa02-6a7d4c2bff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c8f206-a93a-4722-aa02-6a7d4c2bff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eea215b-febb-4397-8563-8f0e31917b68', 'volume_name': 'volume-4eea215b-febb-4397-8563-8f0e31917b68', 'volume_size': 2}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85efc40-dbea-4383-9641-0216cf2a3fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85efc40-dbea-4383-9641-0216cf2a3fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d83235-7819-42b9-bc4e-c3ad1bf7d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Volume 4eea215b-febb-4397-8563-8f0e31917b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eea215b-febb-4397-8563-8f0e31917b68', 'volume_size': 2} Sep 07 09:51:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:23 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 1073741824" returned: 0 in 0.641s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:23 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 Sep 07 09:51:23 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:23 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23" returned: 0 in 0.252s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-116977847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eea215b-febb-4397-8563-8f0e31917b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275453152ec942238ef4c785c7d6996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:23Z,use_quota=True,user_id='4f6549b5817f4ecaaad2c251a7024840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Creating volume 4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:23 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 2147483648 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a693f42-db87-4550-b577-23108e0b0bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab89f27e-3827-497a-9a49-cd69eaeeca23', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:23 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 2147483648 Sep 07 09:51:23 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c4ed35-21ea-44ee-a21e-87889cf6dc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 (ab89f27e-3827-497a-9a49-cd69eaeeca23): created successfully Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c4ed35-21ea-44ee-a21e-87889cf6dc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (4e3afe6e-d684-4261-ba0b-b18764f91f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9f05f8f0-8c33-48c8-b9ab-ee47c342fb66 tempest-VolumesSnapshotTestJSON-1049942510 None] Created volume successfully. Sep 07 09:51:23 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 2147483648" returned: 0 in 0.561s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:24 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 Sep 07 09:51:24 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:24 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68" returned: 0 in 0.332s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d83235-7819-42b9-bc4e-c3ad1bf7d70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eea215b-febb-4397-8563-8f0e31917b68', 'volume_size': 2}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27659545-786d-467a-8265-f92794aea20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:24 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Volume volume-4eea215b-febb-4397-8563-8f0e31917b68 (4eea215b-febb-4397-8563-8f0e31917b68): created successfully Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27659545-786d-467a-8265-f92794aea20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Flow 'volume_create_manager' (5dc7fe1d-6d7d-483a-86ac-c580fd891533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:24 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-49c06e65-129f-465c-86d8-6b1b80d4e820 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Created volume successfully. Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Creating offline snapshot a2f454cf-d981-4cbf-87bf-f46833575437 of volume ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e911e6da-574b-4b7a-b453-6fd4eb53bc14]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:24 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 Sep 07 09:51:24 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:25 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23" returned: 0 in 0.442s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:25 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 1G Sep 07 09:51:25 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:25 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 1G" returned: 0 in 0.430s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:25 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 Sep 07 09:51:25 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:26 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437" returned: 0 in 0.405s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:26 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 is being set with open permissions: ugo+rw Sep 07 09:51:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:26 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 Sep 07 09:51:26 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:26 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437" returned: 0 in 0.280s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:26 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.info Sep 07 09:51:26 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:26 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.info" returned: 0 in 0.316s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:26 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.info is being set with open permissions: ugo+rw Sep 07 09:51:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:26 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.info Sep 07 09:51:26 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:26 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.info" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Creating offline snapshot 5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 of volume 4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:51:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2f276d9a-1db9-4b9c-97d4-9daa79c314d9 tempest-VolumesSnapshotTestJSON-1049942510 None] Create snapshot completed successfully Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04286aa-7522-417d-93e3-2a58c3f63bbf]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:27 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 Sep 07 09:51:27 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:27 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68" returned: 0 in 0.427s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 2G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:27 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 2G Sep 07 09:51:27 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "cinder-77644d46-365c-4aed-a19a-6409030cea95-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-77644d46-365c-4aed-a19a-6409030cea95-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "cinder-quobyte-77644d46-365c-4aed-a19a-6409030cea95" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-quobyte-77644d46-365c-4aed-a19a-6409030cea95" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc8930-070a-4d40-88b6-4d838201f3b6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:28 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 2G" returned: 0 in 0.666s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eea215b-febb-4397-8563-8f0e31917b68 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:28 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 Sep 07 09:51:28 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:28 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eea215b-febb-4397-8563-8f0e31917b68 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 Sep 07 09:51:28 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:28 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95" returned: 0 in 0.569s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:28 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95 Sep 07 09:51:28 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:28 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eea215b-febb-4397-8563-8f0e31917b68 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" returned: 0 in 0.425s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:28 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 is being set with open permissions: ugo+rw Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:28 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 Sep 07 09:51:28 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (4a1883f7-c5f8-4f90-a8a0-8f0634a07ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8e2ff1-8ede-44d3-a2dd-6ce7075c99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:28 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" returned: 0 in 0.358s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8e2ff1-8ede-44d3-a2dd-6ce7075c99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-898556847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c822d5-f72e-4faa-b1da-aad7b3f76012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a2f454cf-d981-4cbf-87bf-f46833575437,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:29Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b8586e-7821-454d-8103-febf76414d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b8586e-7821-454d-8103-febf76414d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c216e97f-d67e-403b-be65-c7cb2aee6104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c216e97f-d67e-403b-be65-c7cb2aee6104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6c822d5-f72e-4faa-b1da-aad7b3f76012', 'volume_name': 'volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012', 'volume_size': 2, 'snapshot_id': 'a2f454cf-d981-4cbf-87bf-f46833575437'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e122075e-2e9a-4b52-8243-86c435822ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e122075e-2e9a-4b52-8243-86c435822ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b28072-a7b4-4af9-87c1-067639bd8772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:29 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume e6c822d5-f72e-4faa-b1da-aad7b3f76012: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012', 'volume_size': 2, 'snapshot_id': 'a2f454cf-d981-4cbf-87bf-f46833575437'} Sep 07 09:51:29 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-77644d46-365c-4aed-a19a-6409030cea95" returned: 0 in 0.497s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-quobyte-77644d46-365c-4aed-a19a-6409030cea95" released by "delete_volume" :: held 1.134s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:29 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.info Sep 07 09:51:29 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Created reservations ['361ed57e-b408-4d3e-a387-87397d7456be', '3fb0518e-e996-47b7-8a42-91781ca22463', '16bdb0e9-a028-4de2-8bc8-30e4d5ecbb0c', '06b1d849-0755-4ac9-b884-44b047db60c2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:29 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:29 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:29 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.info" returned: 0 in 0.369s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:29 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.info is being set with open permissions: ugo+rw Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:29 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.info Sep 07 09:51:29 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:29 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.313s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Deleted volume successfully. Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8349c109-bf11-432d-81ba-ce1db1472077 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-77644d46-365c-4aed-a19a-6409030cea95-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:29 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.info" returned: 0 in 0.280s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.704s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-a2f454cf-d981-4cbf-87bf-f46833575437-e6c822d5-f72e-4faa-b1da-aad7b3f76012" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-a2f454cf-d981-4cbf-87bf-f46833575437-e6c822d5-f72e-4faa-b1da-aad7b3f76012" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Creating volume e6c822d5-f72e-4faa-b1da-aad7b3f76012 from snapshot a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-e6c822d5-f72e-4faa-b1da-aad7b3f76012" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e476ba3c-f76c-4d8e-be1f-8d6975baa551 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Create snapshot completed successfully Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e6c822d5-f72e-4faa-b1da-aad7b3f76012" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] snapshot: a2f454cf-d981-4cbf-87bf-f46833575437, volume: e6c822d5-f72e-4faa-b1da-aad7b3f76012, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a884ac-d019-4f29-9187-9dd545303824]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:30 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 Sep 07 09:51:30 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "cinder-52034ad2-ded0-4154-831f-088c133557dd-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-52034ad2-ded0-4154-831f-088c133557dd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "cinder-5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:30 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437" returned: 0 in 0.591s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab89f27e-3827-497a-9a49-cd69eaeeca23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "cinder-quobyte-52034ad2-ded0-4154-831f-088c133557dd" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "cinder-quobyte-4eea215b-febb-4397-8563-8f0e31917b68" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4f2e33-398e-4a9a-b4ce-b57bd22b9ded]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-quobyte-52034ad2-ded0-4154-831f-088c133557dd" acquired by "delete_volume" :: waited 0.042s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-quobyte-4eea215b-febb-4397-8563-8f0e31917b68" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "cinder-quobyte-5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[216c4668-c866-460f-b7d6-0eb88fbd1a46]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-quobyte-5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Deleting offline snapshot 5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 of volume 4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] snapshot_file for this snap is: volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4cd014-b618-4114-bbed-66158de32266]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:30 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 Sep 07 09:51:30 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:30 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd Sep 07 09:51:30 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:30 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 Sep 07 09:51:30 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:31 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd" returned: 0 in 0.496s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:31 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd Sep 07 09:51:31 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:31 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23" returned: 0 in 0.657s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:31 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:31 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 Sep 07 09:51:31 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" returned: 0 in 0.588s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eea215b-febb-4397-8563-8f0e31917b68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe386f77-b615-45de-9993-ae8f7f9f29e0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:31 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-52034ad2-ded0-4154-831f-088c133557dd" returned: 0 in 0.397s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-quobyte-52034ad2-ded0-4154-831f-088c133557dd" released by "delete_volume" :: held 0.966s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:31 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 Sep 07 09:51:31 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Created reservations ['5ce8b6c8-e8e7-4a24-870b-0803f4bd8afe', 'fae4e91e-4b54-4969-b964-c6142d074bb8', '9c3c0870-8cd8-4c09-b64e-d3cd52858c7d', 'fa0eb270-bfe6-4d12-9e10-42408c587e82'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:31 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:31 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:31 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68" returned: 0 in 0.607s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:31 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 Sep 07 09:51:31 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:32 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.421s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:32 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:32 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Deleted volume successfully. Sep 07 09:51:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bff23ab5-c894-43c6-9044-1ecd30c39242 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-52034ad2-ded0-4154-831f-088c133557dd-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:32 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" returned: 0 in 0.823s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:32 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73 Sep 07 09:51:32 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:33 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68.5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" returned: 0 in 0.525s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-quobyte-5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73" released by "_delete_snapshot" :: held 2.763s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-quobyte-4eea215b-febb-4397-8563-8f0e31917b68" released by "delete_snapshot" :: held 2.832s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "cinder-0581b747-b7a0-40cd-83c7-f1fe15c5fa11-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-0581b747-b7a0-40cd-83c7-f1fe15c5fa11-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "cinder-quobyte-0581b747-b7a0-40cd-83c7-f1fe15c5fa11" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-quobyte-0581b747-b7a0-40cd-83c7-f1fe15c5fa11" acquired by "delete_volume" :: waited 0.053s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Created reservations ['a18c1379-ac23-4b62-8f35-44961ae346e6', '68db0d33-2b27-49f7-b624-b71edc050f1b', 'aaa8b48f-18af-4d5c-a082-a966384eb554', '619013b8-b0f7-4160-a335-2ffefb3125ae'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa12538-f877-41da-b6c9-e1bbb582f537]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:33 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Delete snapshot completed successfully. Sep 07 09:51:33 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 Sep 07 09:51:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-62d8e440-33f1-43cf-a9c8-6d097742a6b3 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-5df4ba9f-5ee5-4e8a-9a73-9ee590b66a73-delete_snapshot" released by "delete_snapshot" :: held 3.484s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:33 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:34 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11" returned: 0 in 0.709s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:34 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11 Sep 07 09:51:34 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:35 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0581b747-b7a0-40cd-83c7-f1fe15c5fa11" returned: 0 in 0.568s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-quobyte-0581b747-b7a0-40cd-83c7-f1fe15c5fa11" released by "delete_volume" :: held 1.407s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "cinder-4eea215b-febb-4397-8563-8f0e31917b68-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Created reservations ['7568a2fb-152c-4c1d-b7d3-5ed72a0804ba', '8f392bb0-b94a-41c1-928f-fa94c0b8fb1b', 'd0ceee78-9849-4fba-9b98-4b18eca141a4', 'd0c7f368-4ce8-4aa4-a1ea-6781425697fa'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-4eea215b-febb-4397-8563-8f0e31917b68-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "cinder-quobyte-4eea215b-febb-4397-8563-8f0e31917b68" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-quobyte-4eea215b-febb-4397-8563-8f0e31917b68" acquired by "delete_volume" :: waited 0.056s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b568d2c-bbad-4489-bc3a-a5a24ac7bb31]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:35 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:35 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:35 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 Sep 07 09:51:35 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:36 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.412s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:36 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:36 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Deleted volume successfully. Sep 07 09:51:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d549bcea-69d5-4b44-942f-15df9b500cb0 tempest-AttachVolumeNegativeTest-1432735598 None] Lock "cinder-0581b747-b7a0-40cd-83c7-f1fe15c5fa11-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:36 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68" returned: 0 in 1.094s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:36 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68 Sep 07 09:51:36 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:37 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4eea215b-febb-4397-8563-8f0e31917b68" returned: 0 in 0.550s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-quobyte-4eea215b-febb-4397-8563-8f0e31917b68" released by "delete_volume" :: held 1.800s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:37 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012" returned: 0 in 6.129s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:51:37 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Converted 1024.00 MB image at 167.04 MB/s Sep 07 09:51:37 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 is being set with open permissions: ugo+rw Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:37 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 Sep 07 09:51:37 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Created reservations ['64a8028a-4e6b-42d7-81f0-c5b4fae43b51', 'f459e345-7687-48ca-b769-0254f8f41d19', '238a6ca9-f17b-4ab9-b997-12f0d56776a4', 'ca8df626-0e04-4042-b58f-4c2f775d5e07'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:37 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:37 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:37 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012" returned: 0 in 0.315s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e6c822d5-f72e-4faa-b1da-aad7b3f76012" released by "_copy_volume_from_snapshot" :: held 7.830s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:37 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-a2f454cf-d981-4cbf-87bf-f46833575437-e6c822d5-f72e-4faa-b1da-aad7b3f76012" released by "_create_volume_from_snapshot" :: held 7.947s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.975s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.288s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Deleted volume successfully. Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b28072-a7b4-4af9-87c1-067639bd8772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012', 'volume_size': 2, 'snapshot_id': 'a2f454cf-d981-4cbf-87bf-f46833575437'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211a211e-f57a-4130-9ed3-233e14333626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ce212ba6-bdf9-419a-8ce2-518555aad8f4 tempest-VolumesSnapshotNegativeTestJSON-1336394957 None] Lock "cinder-4eea215b-febb-4397-8563-8f0e31917b68-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:37 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 (e6c822d5-f72e-4faa-b1da-aad7b3f76012): created successfully Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211a211e-f57a-4130-9ed3-233e14333626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (4a1883f7-c5f8-4f90-a8a0-8f0634a07ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7bca72ca-ff0f-4e03-9eaf-9040e60da618 tempest-VolumesSnapshotTestJSON-1049942510 None] Created volume successfully. Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-e6c822d5-f72e-4faa-b1da-aad7b3f76012-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-e6c822d5-f72e-4faa-b1da-aad7b3f76012-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-e6c822d5-f72e-4faa-b1da-aad7b3f76012" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e6c822d5-f72e-4faa-b1da-aad7b3f76012" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be8fbb-8829-4ad9-acb7-b75de9b03ba8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:39 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 Sep 07 09:51:39 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:39 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012" returned: 0 in 0.467s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:39 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012 Sep 07 09:51:39 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:40 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e6c822d5-f72e-4faa-b1da-aad7b3f76012" returned: 0 in 0.457s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e6c822d5-f72e-4faa-b1da-aad7b3f76012" released by "delete_volume" :: held 1.012s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['174f7e40-ecd9-43cf-a500-06737d7e80c3', 'b1c05013-fd22-4974-94c1-cd2de47f7372', 'eef60e55-4cc5-4e33-b6cd-f9bd4de3dcec', '4f89e22f-30e1-4453-80aa-2e8b319ec987'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:40 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:40 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:40 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Deleted volume successfully. Sep 07 09:51:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a5b47091-4c9f-487c-85c2-e5337fe24d1d tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-e6c822d5-f72e-4faa-b1da-aad7b3f76012-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:41 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:41 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:41 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.341s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-a2f454cf-d981-4cbf-87bf-f46833575437-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-a2f454cf-d981-4cbf-87bf-f46833575437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-ab89f27e-3827-497a-9a49-cd69eaeeca23" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-ab89f27e-3827-497a-9a49-cd69eaeeca23" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-a2f454cf-d981-4cbf-87bf-f46833575437" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-a2f454cf-d981-4cbf-87bf-f46833575437" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Deleting offline snapshot a2f454cf-d981-4cbf-87bf-f46833575437 of volume ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] snapshot_file for this snap is: volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[25673bb6-a39e-4a5e-8731-c715d03aa2b2]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:41 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 Sep 07 09:51:41 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:42 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437" returned: 0 in 0.499s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab89f27e-3827-497a-9a49-cd69eaeeca23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:51:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb517c7-358d-4daa-b683-e753962517dc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:42 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 Sep 07 09:51:42 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:42 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23" returned: 0 in 0.654s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:42 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 Sep 07 09:51:42 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:43 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437" returned: 0 in 0.458s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:43 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437 Sep 07 09:51:43 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:43 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23.a2f454cf-d981-4cbf-87bf-f46833575437" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=125,cinder:INSERT=50,cinder:UPDATE=146,cinder:DELETE=10 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-a2f454cf-d981-4cbf-87bf-f46833575437" released by "_delete_snapshot" :: held 2.040s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-ab89f27e-3827-497a-9a49-cd69eaeeca23" released by "delete_snapshot" :: held 2.068s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['600baca2-28e8-4e05-8579-c63c7ce0a78d', '1a66ed1a-8115-4aab-b68f-df38cc3a2c59', '104fe797-5dc2-4851-b4e9-e3aad0c3aeea', '22cb4b66-8a24-4b53-b11b-a32fe4802f1b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Delete snapshot completed successfully. Sep 07 09:51:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f53f1e61-b123-4d3a-a95c-ab339ec97779 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-a2f454cf-d981-4cbf-87bf-f46833575437-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-ab89f27e-3827-497a-9a49-cd69eaeeca23-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-ab89f27e-3827-497a-9a49-cd69eaeeca23-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-ab89f27e-3827-497a-9a49-cd69eaeeca23" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-ab89f27e-3827-497a-9a49-cd69eaeeca23" acquired by "delete_volume" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b55cb-80ee-4bfa-bea2-5050faece2cc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:45 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 Sep 07 09:51:45 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:46 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23" returned: 0 in 0.968s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:46 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23 Sep 07 09:51:46 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:46 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ab89f27e-3827-497a-9a49-cd69eaeeca23" returned: 0 in 0.451s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-ab89f27e-3827-497a-9a49-cd69eaeeca23" released by "delete_volume" :: held 1.557s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:46 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['c52326d3-b0ab-4020-b355-a732a490ca3f', '0fc328e0-379a-4385-b1e4-6f417307cc3c', 'e0a490c3-eff2-4e8b-9306-32ee11ad5517', 'c8f33ee5-8347-4b3f-843f-c65062662fd8'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:47 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:51:47 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:47 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.592s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:51:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Deleted volume successfully. Sep 07 09:51:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59ac535e-801c-4d08-bc01-156310e305a1 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-ab89f27e-3827-497a-9a49-cd69eaeeca23-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=126,cinder:UPDATE=144,cinder:INSERT=32,cinder:DELETE=12 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (7a93d589-1f9e-45e6-8b76-c996f2940d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35386cba-d170-44d8-8498-36081fcde4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35386cba-d170-44d8-8498-36081fcde4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1756479415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4cd080-8c60-4842-9f63-0e35196e8143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:48Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157f6f89-5641-44e8-8285-5dbe0c89aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157f6f89-5641-44e8-8285-5dbe0c89aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef695d44-efb0-48f1-9155-a85c133363f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef695d44-efb0-48f1-9155-a85c133363f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4cd080-8c60-4842-9f63-0e35196e8143', 'volume_name': 'volume-7e4cd080-8c60-4842-9f63-0e35196e8143', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c30b3bf-1bc7-4ca5-813a-2331b1ee8e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c30b3bf-1bc7-4ca5-813a-2331b1ee8e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e135ba9c-1cbe-442c-9d12-828e702c565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:48 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume 7e4cd080-8c60-4842-9f63-0e35196e8143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4cd080-8c60-4842-9f63-0e35196e8143', 'volume_size': 1} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1756479415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4cd080-8c60-4842-9f63-0e35196e8143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:48Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Creating volume 7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:48 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:48 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 1073741824 Sep 07 09:51:48 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:49 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 1073741824" returned: 0 in 0.889s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:49 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 Sep 07 09:51:49 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:50 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143" returned: 0 in 0.651s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:50 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e135ba9c-1cbe-442c-9d12-828e702c565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4cd080-8c60-4842-9f63-0e35196e8143', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4613c4-9996-420b-a9be-0b4df642f0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:50 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Volume volume-7e4cd080-8c60-4842-9f63-0e35196e8143 (7e4cd080-8c60-4842-9f63-0e35196e8143): created successfully Sep 07 09:51:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4613c4-9996-420b-a9be-0b4df642f0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (7a93d589-1f9e-45e6-8b76-c996f2940d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:50 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a57edbd3-4c53-4239-a6d3-e3118123e345 tempest-VolumesSnapshotTestJSON-1049942510 None] Created volume successfully. Sep 07 09:51:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Creating offline snapshot e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 of volume 7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:51:51 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[fece04df-6ca7-4dd2-81c9-d7c8153e7c16]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-be5f3e5c-482f-4b16-916e-cafa6130eec6 tempest-GroupSnapshotsV319Test-883387433 None] Group tempest-GroupSnapshotsV319Test-Group-1490691713: creating Sep 07 09:51:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-be5f3e5c-482f-4b16-916e-cafa6130eec6 tempest-GroupSnapshotsV319Test-883387433 None] Group tempest-GroupSnapshotsV319Test-Group-1490691713: created successfully Sep 07 09:51:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-be5f3e5c-482f-4b16-916e-cafa6130eec6 tempest-GroupSnapshotsV319Test-883387433 None] Create group completed successfully. Sep 07 09:51:51 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 Sep 07 09:51:51 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:51 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143" returned: 0 in 0.714s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:51 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 1G Sep 07 09:51:51 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:52 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 1G" returned: 0 in 0.825s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e4cd080-8c60-4842-9f63-0e35196e8143 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:52 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e4cd080-8c60-4842-9f63-0e35196e8143 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 Sep 07 09:51:52 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:53 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e4cd080-8c60-4842-9f63-0e35196e8143 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" returned: 0 in 0.801s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:53 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 is being set with open permissions: ugo+rw Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:53 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 Sep 07 09:51:53 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Flow 'volume_create_manager' (e67f2af4-676b-4db0-b959-11879976c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cc95ba-67fe-4cc1-8410-64b1f087521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cc95ba-67fe-4cc1-8410-64b1f087521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1776937137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77d1cb32-cd63-4ed1-9b09-a44474f39b38,host='devstack@QuobyteHD#QuobyteHD',id=6a16eed8-f999-40f8-aad4-3deff9a4f16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dfea9bd374d4d6ab83ed4cef9badcf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:54Z,use_quota=True,user_id='22f21b6f763743f58d92e2910ba5bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e6a2aa8-f1bf-4fb6-848e-936260dff71f),volume_type_id=7e6a2aa8-f1bf-4fb6-848e-936260dff71f)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77046b50-329b-41af-8be1-3a3cd5d07130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77046b50-329b-41af-8be1-3a3cd5d07130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb0a7c5-ca87-4ca3-99e0-11065dae39e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb0a7c5-ca87-4ca3-99e0-11065dae39e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a16eed8-f999-40f8-aad4-3deff9a4f16b', 'volume_name': 'volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4b75a6-7fc0-4df1-a2fb-6d349c3e6a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4b75a6-7fc0-4df1-a2fb-6d349c3e6a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a678ba-e48b-4ce5-a81f-5a626d4df4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:53 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Volume 6a16eed8-f999-40f8-aad4-3deff9a4f16b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b', 'volume_size': 1} Sep 07 09:51:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:54 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" returned: 0 in 0.552s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:54 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.info Sep 07 09:51:54 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:54 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.info" returned: 0 in 0.408s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:54 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.info is being set with open permissions: ugo+rw Sep 07 09:51:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:54 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.info Sep 07 09:51:54 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:54 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.info" returned: 0 in 0.482s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.947s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77d1cb32-cd63-4ed1-9b09-a44474f39b38,created_at=2026-09-07T07:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1776937137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77d1cb32-cd63-4ed1-9b09-a44474f39b38,host='devstack@QuobyteHD#QuobyteHD',id=6a16eed8-f999-40f8-aad4-3deff9a4f16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dfea9bd374d4d6ab83ed4cef9badcf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:54Z,use_quota=True,user_id='22f21b6f763743f58d92e2910ba5bef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e6a2aa8-f1bf-4fb6-848e-936260dff71f),volume_type_id=7e6a2aa8-f1bf-4fb6-848e-936260dff71f)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Creating volume 6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:55 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:55 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b 1073741824 Sep 07 09:51:55 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-982a0a19-9fac-4870-ba7d-457373725249 tempest-VolumesSnapshotTestJSON-1049942510 None] Create snapshot completed successfully Sep 07 09:51:55 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b 1073741824" returned: 0 in 0.754s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:55 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b Sep 07 09:51:55 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (c6e6ed4f-7b33-4fc4-a047-a485949790f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d86ca6-6169-4006-a45d-8a629d340a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d86ca6-6169-4006-a45d-8a629d340a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071055708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20218c55685499c9a297ab10363ccd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e7fd9fc9-d028-4c78-bcfc-eb0a53978f97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:51:56Z,use_quota=True,user_id='cc5109ca8ff24bd986228416138d7fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46157c0d-3428-4a48-8217-22ba46e923ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46157c0d-3428-4a48-8217-22ba46e923ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2dd6a3-b4f6-45b2-b8dc-a87707af8066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2dd6a3-b4f6-45b2-b8dc-a87707af8066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c', 'volume_name': 'volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c', 'volume_size': 1, 'snapshot_id': 'e7fd9fc9-d028-4c78-bcfc-eb0a53978f97'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c178ed5-deba-4b51-8d25-ae0d93d7b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c178ed5-deba-4b51-8d25-ae0d93d7b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1baa88-7c4e-4329-a584-f8ba752008b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Volume d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c', 'volume_size': 1, 'snapshot_id': 'e7fd9fc9-d028-4c78-bcfc-eb0a53978f97'} Sep 07 09:51:56 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b" returned: 0 in 0.514s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a678ba-e48b-4ce5-a81f-5a626d4df4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90050666-533f-4540-b056-b23c5805ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Creating volume d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c from snapshot e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:51:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Volume volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b (6a16eed8-f999-40f8-aad4-3deff9a4f16b): created successfully Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90050666-533f-4540-b056-b23c5805ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Flow 'volume_create_manager' (e67f2af4-676b-4db0-b959-11879976c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] snapshot: e7fd9fc9-d028-4c78-bcfc-eb0a53978f97, volume: d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:51:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b85e8310-3358-417e-bb1d-aa790cfe69eb tempest-GroupSnapshotsV319Test-883387433 None] Created volume successfully. Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e959aab-597c-4bae-b9b1-57fde9546641]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:56 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 Sep 07 09:51:56 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:57 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" returned: 0 in 0.507s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e4cd080-8c60-4842-9f63-0e35196e8143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada37d7-9f9e-414f-a096-9cabcf59f5c6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:57 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 Sep 07 09:51:57 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143" returned: 0 in 0.434s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:51:57 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:51:57 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c Sep 07 09:51:57 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:51:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] GroupSnapshot a9cad983-5448-4a84-9773-be723181ed51: creating. Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Group snapshot a9cad983-5448-4a84-9773-be723181ed51: creating. {{(pid=87290) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 09:51:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:03 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" returned: 0 in 5.578s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:52:03 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Converted 1024.00 MB image at 183.54 MB/s Sep 07 09:52:03 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c is being set with open permissions: ugo+rw Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:03 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c Sep 07 09:52:03 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:03 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" returned: 0 in 0.267s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" released by "_copy_volume_from_snapshot" :: held 6.932s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" released by "_create_volume_from_snapshot" :: held 7.022s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.063s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.568s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Creating offline snapshot c76c622d-bf59-48cd-96bc-193073a81fe4 of volume 6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1baa88-7c4e-4329-a584-f8ba752008b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c', 'volume_size': 1, 'snapshot_id': 'e7fd9fc9-d028-4c78-bcfc-eb0a53978f97'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac01e7ae-d72e-4e01-bfb2-786dbe959b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527408c-f52f-43f1-8c5a-337204bc4579]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Volume volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c (d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c): created successfully Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac01e7ae-d72e-4e01-bfb2-786dbe959b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Flow 'volume_create_manager' (c6e6ed4f-7b33-4fc4-a047-a485949790f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-60d4675d-8e93-4ee5-9647-433f2a37c87b tempest-VolumesSnapshotTestJSON-1049942510 None] Created volume successfully. Sep 07 09:52:03 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b Sep 07 09:52:03 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:03 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b" returned: 0 in 0.371s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:03 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 1G Sep 07 09:52:03 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[618083ba-e34c-4d4f-a96c-fec693a4e614]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:04 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 1G" returned: 0 in 0.484s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:04 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 Sep 07 09:52:04 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:04 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c Sep 07 09:52:04 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:04 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4" returned: 0 in 0.331s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:04 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:04 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 Sep 07 09:52:04 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:04 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" returned: 0 in 0.429s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:04 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c Sep 07 09:52:04 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:04 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:05 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.info Sep 07 09:52:05 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:05 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c" released by "delete_volume" :: held 0.733s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['416dd8e1-ff29-45b3-9dcb-e8f223f8f976', '4a007f3c-e26b-4bcb-b201-84ab6582d2ae', 'c7876181-96e0-4304-a922-9d4570cbbbd5', '5ae91a8d-8058-4892-bb7f-bae645ba5341'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:05 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:52:05 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:05 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.info" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:05 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:05 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.info Sep 07 09:52:05 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:05 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.277s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Deleted volume successfully. Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-7e4cd080-8c60-4842-9f63-0e35196e8143" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-86d49be6-eb38-429e-b210-d9bf522770b4 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-d9e0bb94-7296-4fcb-a5b4-cb5b9bc9a89c-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-7e4cd080-8c60-4842-9f63-0e35196e8143" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Deleting offline snapshot e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 of volume 7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] snapshot_file for this snap is: volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4b0602-2a69-41d4-b2d8-96914de3ec3a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:05 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.info" returned: 0 in 0.377s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:05 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 Sep 07 09:52:05 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-47843aeb-7f1a-437f-87ad-ea41b58a492e tempest-GroupSnapshotsV319Test-883387433 None] group_snapshot a9cad983-5448-4a84-9773-be723181ed51: created successfully Sep 07 09:52:06 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" returned: 0 in 0.563s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e4cd080-8c60-4842-9f63-0e35196e8143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdac4498-73e7-40a7-bb95-00ba61098365]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:06 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 Sep 07 09:52:06 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:06 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143" returned: 0 in 0.580s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:06 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 Sep 07 09:52:06 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] group_snapshot a9cad983-5448-4a84-9773-be723181ed51: deleting Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] group_snapshot a9cad983-5448-4a84-9773-be723181ed51: deleting {{(pid=87290) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 09:52:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Acquiring lock "cinder-quobyte-6a16eed8-f999-40f8-aad4-3deff9a4f16b" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Lock "cinder-quobyte-6a16eed8-f999-40f8-aad4-3deff9a4f16b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Acquiring lock "cinder-quobyte-c76c622d-bf59-48cd-96bc-193073a81fe4" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Lock "cinder-quobyte-c76c622d-bf59-48cd-96bc-193073a81fe4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Deleting offline snapshot c76c622d-bf59-48cd-96bc-193073a81fe4 of volume 6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] snapshot_file for this snap is: volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d47e1ad-018b-4773-ab71-0206a54eaa31]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" returned: 0 in 0.456s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97 Sep 07 09:52:07 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:07 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 Sep 07 09:52:07 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:07 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143.e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:07 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97" released by "_delete_snapshot" :: held 1.975s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-7e4cd080-8c60-4842-9f63-0e35196e8143" released by "delete_snapshot" :: held 2.035s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccbc821-3a5f-4e96-861a-8e03663a54e3]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['92624603-d1f2-4af5-9973-751bad6aa07f', '4f7f9da7-51fc-4135-9320-1dcab306680f', '64d2afe4-6f64-4ed4-be1b-a3a6799930d4', '5d98e354-1c08-4fa0-a9fc-e49798bcc5bb'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:07 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b Sep 07 09:52:07 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:07 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Delete snapshot completed successfully. Sep 07 09:52:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-91a6fc77-5f43-4ca5-8747-6f1b5c66d1a0 tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-e7fd9fc9-d028-4c78-bcfc-eb0a53978f97-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:08 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b" returned: 0 in 0.461s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:08 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 Sep 07 09:52:08 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:08 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:08 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4 Sep 07 09:52:08 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:08 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b.c76c622d-bf59-48cd-96bc-193073a81fe4" returned: 0 in 0.311s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Lock "cinder-quobyte-c76c622d-bf59-48cd-96bc-193073a81fe4" released by "_delete_snapshot" :: held 1.791s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Lock "cinder-quobyte-6a16eed8-f999-40f8-aad4-3deff9a4f16b" released by "delete_snapshot" :: held 1.827s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-7e4cd080-8c60-4842-9f63-0e35196e8143-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-7e4cd080-8c60-4842-9f63-0e35196e8143-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:08 devstack cinder-volume[87290]: WARNING cinder.quota [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1993967909 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1993967909, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:52:08 devstack cinder-volume[87290]: WARNING cinder.quota [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1993967909 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1993967909, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-7e4cd080-8c60-4842-9f63-0e35196e8143" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-7e4cd080-8c60-4842-9f63-0e35196e8143" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] Created reservations ['29ad7a94-1884-418b-bff4-e634cb18da19', '42877a60-567f-4d28-ab58-0d224815152a', '332d31f7-4953-4521-955a-0a5995aea204', '5fc8c8fe-48db-4c31-9600-aaf5977e36bd'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6797ea18-afd0-4c8a-800b-5b5268ea0ce5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fd950195-d992-45ae-87d0-63397c714a89 tempest-GroupSnapshotsV319Test-883387433 None] group_snapshot a9cad983-5448-4a84-9773-be723181ed51: deleted successfully Sep 07 09:52:09 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 Sep 07 09:52:09 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:09 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143" returned: 0 in 0.453s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143 Sep 07 09:52:09 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:09 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7e4cd080-8c60-4842-9f63-0e35196e8143" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-7e4cd080-8c60-4842-9f63-0e35196e8143" released by "delete_volume" :: held 0.817s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Acquiring lock "cinder-quobyte-6a16eed8-f999-40f8-aad4-3deff9a4f16b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Lock "cinder-quobyte-6a16eed8-f999-40f8-aad4-3deff9a4f16b" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a58b5a1-3488-4c39-8227-c0313de106a6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['dd5b2521-9789-47a0-81b7-0f53642d278d', 'c79a6b27-976e-4fb3-8d0a-82aaef2976be', '7e19d070-4a3d-4adb-82c2-d98499ca1d18', 'a118a1a2-a0a2-497a-9eb3-e51415778c74'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:52:10 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b Sep 07 09:52:10 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-71c30170-916b-40b4-ba8a-5c4896a59fbd-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-71c30170-916b-40b4-ba8a-5c4896a59fbd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "cinder-quobyte-71c30170-916b-40b4-ba8a-5c4896a59fbd" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-71c30170-916b-40b4-ba8a-5c4896a59fbd" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:10 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.381s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Deleted volume successfully. Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[16642735-cd40-45bb-b8f2-92468dd00bfc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b" returned: 0 in 0.524s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ddaea921-6016-4dc6-8ceb-954f5d495eac tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-7e4cd080-8c60-4842-9f63-0e35196e8143-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:10 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b Sep 07 09:52:10 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd Sep 07 09:52:10 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6a16eed8-f999-40f8-aad4-3deff9a4f16b" returned: 0 in 0.287s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Lock "cinder-quobyte-6a16eed8-f999-40f8-aad4-3deff9a4f16b" released by "delete_volume" :: held 0.879s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Created reservations ['368a5f2b-edff-4792-841c-84bf9d32bfea'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:10 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd" returned: 0 in 0.421s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd Sep 07 09:52:10 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack cinder-volume[87290]: WARNING cinder.quota [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1993967909 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1993967909, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Created reservations ['8cdf92e0-43e2-44f5-8e33-ecda94d31050', '1df4967b-c8ed-4b2e-b35e-dca43cda5366', '85443ddb-1ad8-43ba-82f1-dc799792930c', '91f22db6-a19a-4b27-aa28-7957c4ebfe52'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:11 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:52:11 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:11 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-71c30170-916b-40b4-ba8a-5c4896a59fbd" returned: 0 in 0.290s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-quobyte-71c30170-916b-40b4-ba8a-5c4896a59fbd" released by "delete_volume" :: held 0.791s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Created reservations ['1216c84e-165c-4802-8556-020a15afb5a2', 'd2a87954-d768-4b14-a320-641119f4861c', '51f40d95-41b5-4b39-ad49-e1718e52e1a8', 'ad11b445-5754-4394-9875-5f3865f28a37'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:11 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:52:11 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:11 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.368s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7a2cccd4-c094-4211-ae23-1af35926b580 tempest-GroupSnapshotsV319Test-883387433 None] Delete group completed successfully. Sep 07 09:52:11 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.323s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Deleted volume successfully. Sep 07 09:52:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-368d17b7-edbb-41a1-b507-e8f834d73a9e tempest-VolumesSnapshotTestJSON-1049942510 None] Lock "cinder-71c30170-916b-40b4-ba8a-5c4896a59fbd-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Flow 'volume_create_manager' (01761965-ba38-4f2c-bfe7-7e47d31988a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a06826-72d4-49e2-9daa-311cd69f7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a06826-72d4-49e2-9daa-311cd69f7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-449522912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17aaea2-b47c-4679-bea3-7ac3d6b60569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46cbbc65f6d4140ad5cc80dc714706c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:14Z,use_quota=True,user_id='fbef8c30b4d5422d8cc055cfae78aa4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a5e69c-5d64-4c43-ac67-a5f14d2d6c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a5e69c-5d64-4c43-ac67-a5f14d2d6c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d99e4b9-c06e-45c7-9e57-a52eb0b24d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d99e4b9-c06e-45c7-9e57-a52eb0b24d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17aaea2-b47c-4679-bea3-7ac3d6b60569', 'volume_name': 'volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce470273-056c-4003-a572-613966898b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce470273-056c-4003-a572-613966898b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0737a7fb-a510-4993-8cd8-61381f6b51b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:14 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Volume d17aaea2-b47c-4679-bea3-7ac3d6b60569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569', 'volume_size': 1} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-449522912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17aaea2-b47c-4679-bea3-7ac3d6b60569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46cbbc65f6d4140ad5cc80dc714706c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:14Z,use_quota=True,user_id='fbef8c30b4d5422d8cc055cfae78aa4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Creating volume d17aaea2-b47c-4679-bea3-7ac3d6b60569 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:52:14 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:14 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 1073741824 Sep 07 09:52:14 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:14 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 1073741824" returned: 0 in 0.484s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:14 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 Sep 07 09:52:14 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:14 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0737a7fb-a510-4993-8cd8-61381f6b51b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f323e7a3-ca1a-4324-ae57-bc59202b7b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:14 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Volume volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 (d17aaea2-b47c-4679-bea3-7ac3d6b60569): created successfully Sep 07 09:52:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f323e7a3-ca1a-4324-ae57-bc59202b7b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Flow 'volume_create_manager' (01761965-ba38-4f2c-bfe7-7e47d31988a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-623ec9a8-f9f4-4e37-b288-112c8bd6dd80 tempest-AttachVolumeShelveTestJSON-1597272842 None] Created volume successfully. Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Flow 'volume_create_manager' (31d275fe-0c59-47b7-89a4-e8a91dcb1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c305fbb-6d0c-400e-ad87-28bf40469981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c305fbb-6d0c-400e-ad87-28bf40469981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-227922674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a665609-12f4-4b48-9d43-f2df0d3d1321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddba21f710349bcb60d6df25144b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:23Z,use_quota=True,user_id='b057f221d0834d80ba2ba68ffc7cdb38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad599508-9edd-4559-a092-73db6d6d098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad599508-9edd-4559-a092-73db6d6d098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdb9de1-9b71-43fa-a718-3cdd62c28fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdb9de1-9b71-43fa-a718-3cdd62c28fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a665609-12f4-4b48-9d43-f2df0d3d1321', 'volume_name': 'volume-1a665609-12f4-4b48-9d43-f2df0d3d1321', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24d029-ac2a-44e6-8a1b-1befcb356fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24d029-ac2a-44e6-8a1b-1befcb356fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb987997-fb88-40ec-bf20-13ccd2881349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Volume 1a665609-12f4-4b48-9d43-f2df0d3d1321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a665609-12f4-4b48-9d43-f2df0d3d1321', 'volume_size': 1} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-227922674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a665609-12f4-4b48-9d43-f2df0d3d1321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddba21f710349bcb60d6df25144b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:23Z,use_quota=True,user_id='b057f221d0834d80ba2ba68ffc7cdb38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Creating volume 1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:52:23 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:23 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 1073741824 Sep 07 09:52:23 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:23 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 1073741824" returned: 0 in 0.665s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:23 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 Sep 07 09:52:23 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:24 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321" returned: 0 in 0.295s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:52:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb987997-fb88-40ec-bf20-13ccd2881349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a665609-12f4-4b48-9d43-f2df0d3d1321', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c2faa4-4e54-48d5-9a71-c08d55cd4d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:24 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Volume volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 (1a665609-12f4-4b48-9d43-f2df0d3d1321): created successfully Sep 07 09:52:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c2faa4-4e54-48d5-9a71-c08d55cd4d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Flow 'volume_create_manager' (31d275fe-0c59-47b7-89a4-e8a91dcb1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:24 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-551dad02-d4b1-48e2-889d-cb4e16b3b02f tempest-VolumesSnapshotListTestJSON-1942286503 None] Created volume successfully. Sep 07 09:52:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Creating offline snapshot 22f5f78d-b8cb-444a-ad3d-4f96e190ba21 of volume 1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:52:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d35466f-73e2-4cbf-a946-88f11984fd1b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:25 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 Sep 07 09:52:25 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:26 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321" returned: 0 in 0.843s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:26 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 1G Sep 07 09:52:26 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:27 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 1G" returned: 0 in 0.761s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:27 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 Sep 07 09:52:27 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:27 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21" returned: 0 in 0.466s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:27 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 is being set with open permissions: ugo+rw Sep 07 09:52:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:27 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 Sep 07 09:52:27 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:28 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21" returned: 0 in 0.690s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:28 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.info Sep 07 09:52:28 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:28 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.info" returned: 0 in 0.516s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:28 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.info is being set with open permissions: ugo+rw Sep 07 09:52:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:29 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.info Sep 07 09:52:29 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:29 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.info" returned: 0 in 0.361s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.798s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d8414fa2-8152-458b-8be3-c0a0ea19186b tempest-VolumesSnapshotListTestJSON-1942286503 None] Create snapshot completed successfully Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Creating offline snapshot 2d088c20-e9b7-4c35-a4ba-ed5c4f334861 of volume 1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa45cf-dff6-4003-9ff9-a327d2bf4ae0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-07418da4-8838-4549-8490-8e7a98b0cbd1 req-dd538416-f9b0-4438-9b12-2f5efe330ce6 tempest-AttachVolumeShelveTestJSON-1597272842 None] No connector for attachment c82a2471-2340-4d52-ab97-4327c835c8a6; skipping storage backend terminate_connection call. {{(pid=87290) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-07418da4-8838-4549-8490-8e7a98b0cbd1 req-dd538416-f9b0-4438-9b12-2f5efe330ce6 tempest-AttachVolumeShelveTestJSON-1597272842 None] Deleting attachment c82a2471-2340-4d52-ab97-4327c835c8a6. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:52:30 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 Sep 07 09:52:30 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:30 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21" returned: 0 in 0.482s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a665609-12f4-4b48-9d43-f2df0d3d1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:30 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 1G Sep 07 09:52:30 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:31 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 1G" returned: 0 in 0.734s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:31 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 Sep 07 09:52:31 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:32 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861" returned: 0 in 0.623s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:32 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 is being set with open permissions: ugo+rw Sep 07 09:52:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:32 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 Sep 07 09:52:32 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:32 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861" returned: 0 in 0.371s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:32 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-00a70c59-1c66-4418-9460-82fb29f9d28d tempest-VolumesSnapshotListTestJSON-1942286503 None] Create snapshot completed successfully Sep 07 09:52:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Creating offline snapshot d38e45f7-c4ab-41fa-8652-b9ae550fa93e of volume 1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:52:33 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a254c7f4-2743-46ce-9dc8-5e4c6552ab24]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:33 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 Sep 07 09:52:33 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:34 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861" returned: 0 in 0.566s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a665609-12f4-4b48-9d43-f2df0d3d1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:34 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e 1G Sep 07 09:52:34 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:35 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e 1G" returned: 0 in 0.799s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:35 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e Sep 07 09:52:35 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:35 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e" returned: 0 in 0.377s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:35 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e is being set with open permissions: ugo+rw Sep 07 09:52:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:35 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e Sep 07 09:52:35 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:35 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e" returned: 0 in 0.402s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d0488cb6-9516-43cb-948b-199556ee7773 tempest-VolumesSnapshotListTestJSON-1942286503 None] Create snapshot completed successfully Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-d38e45f7-c4ab-41fa-8652-b9ae550fa93e-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-d38e45f7-c4ab-41fa-8652-b9ae550fa93e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-quobyte-d38e45f7-c4ab-41fa-8652-b9ae550fa93e" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-d38e45f7-c4ab-41fa-8652-b9ae550fa93e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Deleting offline snapshot d38e45f7-c4ab-41fa-8652-b9ae550fa93e of volume 1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] snapshot_file for this snap is: volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b6bb74-9618-40df-b851-b599a80fbbc5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:38 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e Sep 07 09:52:38 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:38 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e" returned: 0 in 0.551s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a665609-12f4-4b48-9d43-f2df0d3d1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fb3721-ccee-4178-8a7c-842099c57b11]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:39 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 Sep 07 09:52:39 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:39 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861" returned: 0 in 0.550s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a665609-12f4-4b48-9d43-f2df0d3d1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:39 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e Sep 07 09:52:39 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:40 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e" returned: 0 in 0.566s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:40 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e Sep 07 09:52:40 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:40 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.d38e45f7-c4ab-41fa-8652-b9ae550fa93e" returned: 0 in 0.281s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-d38e45f7-c4ab-41fa-8652-b9ae550fa93e" released by "_delete_snapshot" :: held 2.088s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" released by "delete_snapshot" :: held 2.131s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:40 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Created reservations ['8a8635c9-7f81-4add-8f58-ccc59cb10c36', '9e977af0-67dd-4cc9-8e2c-8e2cd7afdf98', '0e0607f4-415b-4e09-8eb5-8a53610aab43', '35eca1db-02fe-47c4-b7cf-1d3a766645c4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Delete snapshot completed successfully. Sep 07 09:52:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e8bef77e-f075-4566-a6be-ae567d586b91 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-d38e45f7-c4ab-41fa-8652-b9ae550fa93e-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:41 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:52:41 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:41 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-2d088c20-e9b7-4c35-a4ba-ed5c4f334861-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.452s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-2d088c20-e9b7-4c35-a4ba-ed5c4f334861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-quobyte-2d088c20-e9b7-4c35-a4ba-ed5c4f334861" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-2d088c20-e9b7-4c35-a4ba-ed5c4f334861" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Deleting offline snapshot 2d088c20-e9b7-4c35-a4ba-ed5c4f334861 of volume 1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] snapshot_file for this snap is: volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[befdfe76-1d21-424f-8cd1-21b875f8835c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:41 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 Sep 07 09:52:41 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:42 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861" returned: 0 in 0.502s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a665609-12f4-4b48-9d43-f2df0d3d1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c8e7a-7230-4c40-85b2-59d3a9c11112]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:42 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 Sep 07 09:52:42 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:42 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21" returned: 0 in 0.439s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a665609-12f4-4b48-9d43-f2df0d3d1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:42 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 Sep 07 09:52:42 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:43 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861" returned: 0 in 0.515s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:43 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861 Sep 07 09:52:43 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:43 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.2d088c20-e9b7-4c35-a4ba-ed5c4f334861" returned: 0 in 0.286s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-2d088c20-e9b7-4c35-a4ba-ed5c4f334861" released by "_delete_snapshot" :: held 1.919s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" released by "delete_snapshot" :: held 1.976s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=89,cinder:INSERT=25,cinder:UPDATE=79,cinder:DELETE=6 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Created reservations ['3e16d09f-0c4a-460a-9703-41365a316c37', '431ac131-a13b-4aae-95d3-b5fa6cb57217', '3d30792c-00ef-4d8d-b489-457fc519b006', '75d158f9-7b2a-464d-a4a2-c7712e287ab6'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Delete snapshot completed successfully. Sep 07 09:52:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c23155bd-db06-48ad-8757-8d59fa9c38e2 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-2d088c20-e9b7-4c35-a4ba-ed5c4f334861-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-22f5f78d-b8cb-444a-ad3d-4f96e190ba21-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-22f5f78d-b8cb-444a-ad3d-4f96e190ba21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-quobyte-22f5f78d-b8cb-444a-ad3d-4f96e190ba21" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-22f5f78d-b8cb-444a-ad3d-4f96e190ba21" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Deleting offline snapshot 22f5f78d-b8cb-444a-ad3d-4f96e190ba21 of volume 1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] snapshot_file for this snap is: volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4985969-4772-4d39-9e4d-cc47f7218b0b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:45 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 Sep 07 09:52:45 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:45 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a665609-12f4-4b48-9d43-f2df0d3d1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cb4d3d-77a3-44b8-a1bc-558b6ba3f82c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:45 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 Sep 07 09:52:45 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:45 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321" returned: 0 in 0.399s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:45 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 Sep 07 09:52:45 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:46 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21" returned: 0 in 0.387s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:46 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21 Sep 07 09:52:46 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:46 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321.22f5f78d-b8cb-444a-ad3d-4f96e190ba21" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-22f5f78d-b8cb-444a-ad3d-4f96e190ba21" released by "_delete_snapshot" :: held 1.635s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" released by "delete_snapshot" :: held 1.671s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:46 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Created reservations ['5160b431-8d2c-4156-befb-527a3269a2fb', '2663aee8-3b0b-4b98-ade6-6b21df2e7cf9', 'b1947ef1-c8b8-4c1b-bb03-d21d1e57d137', '3a8ca83b-e0be-481b-8be4-f895b7b12512'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Delete snapshot completed successfully. Sep 07 09:52:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d528fae8-40b5-4e44-9e17-4224c3b690a7 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-22f5f78d-b8cb-444a-ad3d-4f96e190ba21-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-1a665609-12f4-4b48-9d43-f2df0d3d1321-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-1a665609-12f4-4b48-9d43-f2df0d3d1321-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d1664-a2fe-4c97-a704-daf158330513]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:47 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 Sep 07 09:52:47 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:47 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321" returned: 0 in 0.497s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:47 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321 Sep 07 09:52:47 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:48 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a665609-12f4-4b48-9d43-f2df0d3d1321" returned: 0 in 0.330s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-quobyte-1a665609-12f4-4b48-9d43-f2df0d3d1321" released by "delete_volume" :: held 0.912s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Created reservations ['7b436950-6584-4516-bd1d-36fc243dd709', '970ba84f-e577-4e65-a93f-6b4a8d2d1028', '8d88a8e9-836a-4beb-830f-92ff48a2734e', '985f4803-0148-4bcf-bf02-c9d043dd4359'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:48 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:52:48 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:48 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.318s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Deleted volume successfully. Sep 07 09:52:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0474599-9b9a-425a-a804-8b8edee44c66 tempest-VolumesSnapshotListTestJSON-1942286503 None] Lock "cinder-1a665609-12f4-4b48-9d43-f2df0d3d1321-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=110,cinder:INSERT=25,cinder:DELETE=7,cinder:SELECT=82 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Flow 'volume_create_manager' (2e82f788-9e12-4f2b-9b55-c533f19a98ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d4e463-9dee-49b3-9e16-7b4098e037c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d4e463-9dee-49b3-9e16-7b4098e037c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1567305771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf83ee9-4408-417b-a2ec-6366169ad309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715cb90c908946bd95a294a4b0262aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:52Z,use_quota=True,user_id='bd28ec545f18486193643c2fa6b840e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077e0607-1230-4c8f-a98c-1aeb86a97d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077e0607-1230-4c8f-a98c-1aeb86a97d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559b16c4-7b0b-4679-899a-66c772e83ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559b16c4-7b0b-4679-899a-66c772e83ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf83ee9-4408-417b-a2ec-6366169ad309', 'volume_name': 'volume-8cf83ee9-4408-417b-a2ec-6366169ad309', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5e91c6-56ee-4826-83bb-dd93f140d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5e91c6-56ee-4826-83bb-dd93f140d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d41d1d2-5556-4a94-a135-7e8194cfc3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:51 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Volume 8cf83ee9-4408-417b-a2ec-6366169ad309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf83ee9-4408-417b-a2ec-6366169ad309', 'volume_size': 1} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1567305771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf83ee9-4408-417b-a2ec-6366169ad309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715cb90c908946bd95a294a4b0262aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:52Z,use_quota=True,user_id='bd28ec545f18486193643c2fa6b840e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Creating volume 8cf83ee9-4408-417b-a2ec-6366169ad309 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:52:51 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:52:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:52 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 1073741824 Sep 07 09:52:52 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:52 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 1073741824" returned: 0 in 0.769s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:52 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 Sep 07 09:52:52 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Flow 'volume_create_manager' (efb7e214-09f4-4c49-82a7-3f49afc3560f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d136c68e-8c0f-4056-b632-67e34a010fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d136c68e-8c0f-4056-b632-67e34a010fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1525627908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbd31a3-559b-4c52-809c-8cdf1b72b3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b759e864414452aac4407d1f2f97fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:53Z,use_quota=True,user_id='b3bca8461c244127a83a8ef4df81ac41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03ae648-d19f-4d25-a3d6-c1d9932a17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03ae648-d19f-4d25-a3d6-c1d9932a17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4878b0-c2aa-45de-af38-10180697dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4878b0-c2aa-45de-af38-10180697dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbd31a3-559b-4c52-809c-8cdf1b72b3a2', 'volume_name': 'volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ce6f70-c0b9-4d2d-be4d-64bd98b274cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ce6f70-c0b9-4d2d-be4d-64bd98b274cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8d9482-dba5-4bff-95ec-50cab7ed10d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:53 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Volume 3bbd31a3-559b-4c52-809c-8cdf1b72b3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2', 'volume_size': 1} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:53 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309" returned: 0 in 0.501s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.080s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1525627908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbd31a3-559b-4c52-809c-8cdf1b72b3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b759e864414452aac4407d1f2f97fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:52:53Z,use_quota=True,user_id='b3bca8461c244127a83a8ef4df81ac41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Creating volume 3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:52:53 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d41d1d2-5556-4a94-a135-7e8194cfc3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf83ee9-4408-417b-a2ec-6366169ad309', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f639c552-cf1b-42bc-abc8-f045440f367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:53 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 1073741824 Sep 07 09:52:53 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:53 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Volume volume-8cf83ee9-4408-417b-a2ec-6366169ad309 (8cf83ee9-4408-417b-a2ec-6366169ad309): created successfully Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f639c552-cf1b-42bc-abc8-f045440f367c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Flow 'volume_create_manager' (2e82f788-9e12-4f2b-9b55-c533f19a98ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:53 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8049a607-5b2f-4197-946f-569450b0e7bf tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Created volume successfully. Sep 07 09:52:53 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 1073741824" returned: 0 in 0.520s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:53 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 Sep 07 09:52:53 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:54 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2" returned: 0 in 0.384s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8d9482-dba5-4bff-95ec-50cab7ed10d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fbe2ef-c393-4053-9731-0bb085b8bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:52:54 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Volume volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 (3bbd31a3-559b-4c52-809c-8cdf1b72b3a2): created successfully Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fbe2ef-c393-4053-9731-0bb085b8bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Flow 'volume_create_manager' (efb7e214-09f4-4c49-82a7-3f49afc3560f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:52:54 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-abeb6b34-de9b-4ee3-8ba3-b74fec423357 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Created volume successfully. Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-fe287477-eadf-4daf-960c-feeda2fdddde req-36b0f75e-e2f8-42a1-8803-d518ce452383 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-fe287477-eadf-4daf-960c-feeda2fdddde req-36b0f75e-e2f8-42a1-8803-d518ce452383 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-fe287477-eadf-4daf-960c-feeda2fdddde req-36b0f75e-e2f8-42a1-8803-d518ce452383 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-fe287477-eadf-4daf-960c-feeda2fdddde req-36b0f75e-e2f8-42a1-8803-d518ce452383 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-8cf83ee9-4408-417b-a2ec-6366169ad309', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec50c1b3-d35e-4cec-bc6e-cdf5c35f5b23', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:52:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-fe287477-eadf-4daf-960c-feeda2fdddde req-36b0f75e-e2f8-42a1-8803-d518ce452383 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] attachment_update completed successfully. Sep 07 09:52:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Acquiring lock "cinder-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "cinder-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Acquiring lock "cinder-quobyte-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "cinder-quobyte-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2" acquired by "delete_volume" :: waited 0.013s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f740415-60db-480d-8e77-6b5aad2a1fb9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:56 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 Sep 07 09:52:56 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:57 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2" returned: 0 in 0.382s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:57 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2 Sep 07 09:52:57 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:57 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2" returned: 0 in 0.263s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "cinder-quobyte-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2" released by "delete_volume" :: held 0.686s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Created reservations ['ec8bfc7e-e9ae-4272-a602-7c388ebd0bab', '833158b7-56af-47a3-ab77-0aad1e1dcc6d', '6b07f97f-b88a-4948-8067-16b39c8130e3', '4ef98f66-7b78-49ad-8d00-e10f2647bc36'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:57 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:52:57 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:57 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Deleted volume successfully. Sep 07 09:52:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-afbb1b4c-8a19-45e2-97a0-169893a17946 tempest-VolumeQuotasNegativeTestJSON-62071413 None] Lock "cinder-3bbd31a3-559b-4c52-809c-8cdf1b72b3a2-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:52:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-b1d7148f-4f08-4af9-8506-2d7768bbd838 req-2b015338-b1c2-427b-b18e-b7df54597706 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Terminate volume connection completed successfully. Sep 07 09:52:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-b1d7148f-4f08-4af9-8506-2d7768bbd838 req-2b015338-b1c2-427b-b18e-b7df54597706 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Deleting attachment ec50c1b3-d35e-4cec-bc6e-cdf5c35f5b23. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:52:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Acquiring lock "cinder-8cf83ee9-4408-417b-a2ec-6366169ad309-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "cinder-8cf83ee9-4408-417b-a2ec-6366169ad309-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Acquiring lock "cinder-quobyte-8cf83ee9-4408-417b-a2ec-6366169ad309" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:52:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "cinder-quobyte-8cf83ee9-4408-417b-a2ec-6366169ad309" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:52:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91c9de-2e77-452f-be14-4f89dce8b12e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:52:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:59 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 Sep 07 09:52:59 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:00 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309" returned: 0 in 0.431s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:00 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309 Sep 07 09:53:00 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:00 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8cf83ee9-4408-417b-a2ec-6366169ad309" returned: 0 in 0.296s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "cinder-quobyte-8cf83ee9-4408-417b-a2ec-6366169ad309" released by "delete_volume" :: held 0.793s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Created reservations ['27c90af3-6eb7-4bd9-92dd-b6fdc6580ca8', '8a01bb41-a109-4865-8ca6-6adaafac4656', '431b39ea-e95d-415d-856c-512bf6ce8e97', 'c57960ca-6016-4df0-9681-0946a622932d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:00 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:00 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:01 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.366s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:01 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:01 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Deleted volume successfully. Sep 07 09:53:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-769af788-bebd-43fa-8327-8fa7237669f4 tempest-TestServerVolumeAttachScenarioOldVersion-1899408974 None] Lock "cinder-8cf83ee9-4408-417b-a2ec-6366169ad309-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Flow 'volume_create_manager' (34176070-b72a-48f5-996b-2798e34c55b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e35dc3e-09fb-4b00-bbad-ccc938666c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e35dc3e-09fb-4b00-bbad-ccc938666c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1636699941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126a7b3d-179e-48e7-ac6d-36badfb7d318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95951d0932464d3291b94c5d33647709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:06Z,use_quota=True,user_id='844df303cd1247d7aae911b2c9f14a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c22c9b49-f286-4db2-9ae2-2feb845244f9),volume_type_id=c22c9b49-f286-4db2-9ae2-2feb845244f9)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fdf341-76ee-41b8-946d-4382ecd72ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fdf341-76ee-41b8-946d-4382ecd72ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e615fda4-7ddd-477c-a548-ec56cef5a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e615fda4-7ddd-477c-a548-ec56cef5a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '126a7b3d-179e-48e7-ac6d-36badfb7d318', 'volume_name': 'volume-126a7b3d-179e-48e7-ac6d-36badfb7d318', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7526a4be-52af-4ab6-bbdc-9d1de5f01ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7526a4be-52af-4ab6-bbdc-9d1de5f01ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84dbfd7-2586-4eeb-a87b-c35a2021fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:05 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Volume 126a7b3d-179e-48e7-ac6d-36badfb7d318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-126a7b3d-179e-48e7-ac6d-36badfb7d318', 'volume_size': 1} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1636699941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126a7b3d-179e-48e7-ac6d-36badfb7d318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95951d0932464d3291b94c5d33647709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:06Z,use_quota=True,user_id='844df303cd1247d7aae911b2c9f14a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c22c9b49-f286-4db2-9ae2-2feb845244f9),volume_type_id=c22c9b49-f286-4db2-9ae2-2feb845244f9)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Creating volume 126a7b3d-179e-48e7-ac6d-36badfb7d318 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:05 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:05 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 1073741824 Sep 07 09:53:05 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:06 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 1073741824" returned: 0 in 0.654s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:06 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 Sep 07 09:53:06 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:06 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84dbfd7-2586-4eeb-a87b-c35a2021fefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-126a7b3d-179e-48e7-ac6d-36badfb7d318', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb0bf80-530d-4163-9663-446ebdb4a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:07 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Volume volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 (126a7b3d-179e-48e7-ac6d-36badfb7d318): created successfully Sep 07 09:53:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb0bf80-530d-4163-9663-446ebdb4a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Flow 'volume_create_manager' (34176070-b72a-48f5-996b-2798e34c55b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:07 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cfc7f772-6de1-4f5c-bbe9-d081bc131ca3 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Created volume successfully. Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:08 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:08 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:08 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:08 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-80345ece-1429-447b-be4f-82bfe9812ae7 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Retype volume completed successfully. Sep 07 09:53:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Acquiring lock "cinder-126a7b3d-179e-48e7-ac6d-36badfb7d318-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "cinder-126a7b3d-179e-48e7-ac6d-36badfb7d318-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Acquiring lock "cinder-quobyte-126a7b3d-179e-48e7-ac6d-36badfb7d318" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "cinder-quobyte-126a7b3d-179e-48e7-ac6d-36badfb7d318" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[027fcdf5-def3-449c-b351-fa55bffed9eb]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:09 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 Sep 07 09:53:09 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:10 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318" returned: 0 in 0.452s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:10 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318 Sep 07 09:53:10 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:10 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-126a7b3d-179e-48e7-ac6d-36badfb7d318" returned: 0 in 0.358s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "cinder-quobyte-126a7b3d-179e-48e7-ac6d-36badfb7d318" released by "delete_volume" :: held 0.859s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:10 devstack cinder-volume[87290]: WARNING cinder.quota [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:53:10 devstack cinder-volume[87290]: WARNING cinder.quota [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Created reservations ['5c5678ee-7c86-47f6-8a3b-c353db20fc5f', '57f4ab58-2f7e-43be-8a83-9b5902cefed8', 'e1ed25ae-04a8-4194-a03f-851bc9e8e7ff', '0f26dbaa-21af-496c-a394-dd82be7c7579'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:10 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:10 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:11 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.445s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:11 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Deleted volume successfully. Sep 07 09:53:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-aef22ee8-7109-44e6-a2cd-45d7553b1222 tempest-VolumeRetypeWithoutMigrationTest-265502183 None] Lock "cinder-126a7b3d-179e-48e7-ac6d-36badfb7d318-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Acquiring lock "cinder-d17aaea2-b47c-4679-bea3-7ac3d6b60569-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "cinder-d17aaea2-b47c-4679-bea3-7ac3d6b60569-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Acquiring lock "cinder-quobyte-d17aaea2-b47c-4679-bea3-7ac3d6b60569" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "cinder-quobyte-d17aaea2-b47c-4679-bea3-7ac3d6b60569" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f2559a-fc20-4744-b5ed-5ae8e243991b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:17 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 Sep 07 09:53:17 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:17 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569" returned: 0 in 0.455s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:17 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569 Sep 07 09:53:17 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:18 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d17aaea2-b47c-4679-bea3-7ac3d6b60569" returned: 0 in 0.388s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "cinder-quobyte-d17aaea2-b47c-4679-bea3-7ac3d6b60569" released by "delete_volume" :: held 0.909s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Created reservations ['abeaa167-2887-46d3-a77e-6aaa5de19dc7', 'f5e1eb50-6882-4729-99ac-2a3e0fec1192', '4c9f019b-d270-416c-ad7a-6e2f58b9fe16', '0275eb3f-28b7-4190-85ea-d9b47ac7a8cd'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:18 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:18 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:18 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.357s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Deleted volume successfully. Sep 07 09:53:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a8016b5-67ec-448d-abdd-318e5dbda4e0 tempest-AttachVolumeShelveTestJSON-1597272842 None] Lock "cinder-d17aaea2-b47c-4679-bea3-7ac3d6b60569-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:22 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Flow 'volume_create_manager' (2ce38f8e-8440-43f4-b4a4-c7b3f5428fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244657dd-766a-4d28-be8b-dbddcaa4dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244657dd-766a-4d28-be8b-dbddcaa4dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1875982445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdc038c-cae1-4ba0-b739-3c3c78ac5416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82eff11b46c49f4ab1aea5b81d5e3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:23Z,use_quota=True,user_id='7227f6163fb644d2a5f2db762ac8926f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb4c870-30be-4284-9e24-b148e05794ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb4c870-30be-4284-9e24-b148e05794ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3a1122-e776-4340-b5ea-e7feaa520693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3a1122-e776-4340-b5ea-e7feaa520693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdc038c-cae1-4ba0-b739-3c3c78ac5416', 'volume_name': 'volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12c8d7a-a5f4-4aea-8aff-93edb95daa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12c8d7a-a5f4-4aea-8aff-93edb95daa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f470100d-11c4-4947-ae05-5525b1fe4049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Volume 2bdc038c-cae1-4ba0-b739-3c3c78ac5416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416', 'volume_size': 1} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1875982445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdc038c-cae1-4ba0-b739-3c3c78ac5416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82eff11b46c49f4ab1aea5b81d5e3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:23Z,use_quota=True,user_id='7227f6163fb644d2a5f2db762ac8926f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Creating volume 2bdc038c-cae1-4ba0-b739-3c3c78ac5416 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:23 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:23 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 1073741824 Sep 07 09:53:23 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:23 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 1073741824" returned: 0 in 0.567s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:23 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 Sep 07 09:53:23 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:24 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416" returned: 0 in 0.404s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f470100d-11c4-4947-ae05-5525b1fe4049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f046b2-4582-465e-a701-9679fb3b1bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:24 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Volume volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 (2bdc038c-cae1-4ba0-b739-3c3c78ac5416): created successfully Sep 07 09:53:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f046b2-4582-465e-a701-9679fb3b1bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Flow 'volume_create_manager' (2ce38f8e-8440-43f4-b4a4-c7b3f5428fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:24 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-690381c1-2e1a-4a22-8f2d-2294e634a089 tempest-VolumesServicesTestJSON-414011422 None] Created volume successfully. Sep 07 09:53:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Acquiring lock "cinder-2bdc038c-cae1-4ba0-b739-3c3c78ac5416-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Lock "cinder-2bdc038c-cae1-4ba0-b739-3c3c78ac5416-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Acquiring lock "cinder-quobyte-2bdc038c-cae1-4ba0-b739-3c3c78ac5416" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Lock "cinder-quobyte-2bdc038c-cae1-4ba0-b739-3c3c78ac5416" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c5d9cf-c060-4d70-9660-9a0d952b81bf]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:25 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 Sep 07 09:53:25 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:26 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416" returned: 0 in 0.522s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:26 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416 Sep 07 09:53:26 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:26 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2bdc038c-cae1-4ba0-b739-3c3c78ac5416" returned: 0 in 0.325s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Lock "cinder-quobyte-2bdc038c-cae1-4ba0-b739-3c3c78ac5416" released by "delete_volume" :: held 0.924s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Created reservations ['95ee1454-5d69-45ab-8d1b-fd75aea3a855', 'f45c6db2-ee2a-4f54-bcde-e8464e8a3648', '94eaa894-68ff-48b9-a1df-6c9fe2279657', '22f35dcb-cc67-4140-b179-afc6c0dd1e45'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:26 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:26 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:27 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.356s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Deleted volume successfully. Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-844acb16-8546-4e80-885f-0102ff4a71cf tempest-VolumesServicesTestJSON-414011422 None] Lock "cinder-2bdc038c-cae1-4ba0-b739-3c3c78ac5416-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Flow 'volume_create_manager' (ed447cee-2573-4915-ac1b-1f18d2151931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165c6513-0522-4b71-961e-f725b13113eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165c6513-0522-4b71-961e-f725b13113eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-162376819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfab1874c6d4f9da051e0949e819ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:27Z,use_quota=True,user_id='60ac854b6623486baaf1d8bb9042e808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e22f263-1656-4091-ac8a-8951169da6f8),volume_type_id=1e22f263-1656-4091-ac8a-8951169da6f8)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd8d7f3-b3fa-429d-a932-94eb9df053be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd8d7f3-b3fa-429d-a932-94eb9df053be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36643fed-40d9-4198-89a7-9de5f38e99ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36643fed-40d9-4198-89a7-9de5f38e99ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be', 'volume_name': 'volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7b9610-5d5d-4472-a93d-be64e694496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7b9610-5d5d-4472-a93d-be64e694496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf40b146-8988-40dc-bf25-6d3df150178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Volume 64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be', 'volume_size': 1} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-162376819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfab1874c6d4f9da051e0949e819ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:27Z,use_quota=True,user_id='60ac854b6623486baaf1d8bb9042e808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e22f263-1656-4091-ac8a-8951169da6f8),volume_type_id=1e22f263-1656-4091-ac8a-8951169da6f8)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Creating volume 64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:27 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:27 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be 1073741824 Sep 07 09:53:27 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Flow 'volume_create_manager' (a4581686-1870-47ce-b359-e6600f77f403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99851cd4-0ddf-4c18-a4d2-1612217dce02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99851cd4-0ddf-4c18-a4d2-1612217dce02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1719455690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6a5891-edd2-4f58-9f07-5d5053fbccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfab1874c6d4f9da051e0949e819ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:28Z,use_quota=True,user_id='60ac854b6623486baaf1d8bb9042e808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aabe62ae-5048-4df3-8f30-d28173e5001d),volume_type_id=aabe62ae-5048-4df3-8f30-d28173e5001d)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a05fc0-6904-4354-83de-ee8b84096449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a05fc0-6904-4354-83de-ee8b84096449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cb7c56-0a68-41ea-ba51-1d4af0b740b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cb7c56-0a68-41ea-ba51-1d4af0b740b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6a5891-edd2-4f58-9f07-5d5053fbccf4', 'volume_name': 'volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccea6cbb-fac8-47cc-8e90-9239f1ce64f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccea6cbb-fac8-47cc-8e90-9239f1ce64f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87793de0-02f5-4dad-9452-6703807c84eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:28 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Volume 8b6a5891-edd2-4f58-9f07-5d5053fbccf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4', 'volume_size': 1} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:28 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be 1073741824" returned: 0 in 0.831s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:28 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be Sep 07 09:53:28 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:28 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be" returned: 0 in 0.340s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.738s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1719455690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6a5891-edd2-4f58-9f07-5d5053fbccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfab1874c6d4f9da051e0949e819ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:28Z,use_quota=True,user_id='60ac854b6623486baaf1d8bb9042e808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aabe62ae-5048-4df3-8f30-d28173e5001d),volume_type_id=aabe62ae-5048-4df3-8f30-d28173e5001d)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Creating volume 8b6a5891-edd2-4f58-9f07-5d5053fbccf4 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:28 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:28 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 1073741824 Sep 07 09:53:28 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf40b146-8988-40dc-bf25-6d3df150178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc8df71-fc02-4298-b761-68d45b12e9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:28 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Volume volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be (64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be): created successfully Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc8df71-fc02-4298-b761-68d45b12e9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Flow 'volume_create_manager' (ed447cee-2573-4915-ac1b-1f18d2151931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0cce3a0b-098f-4542-af26-4bf6881b8668 tempest-TestInstancesWithCinderVolumes-177735051 None] Created volume successfully. Sep 07 09:53:29 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 1073741824" returned: 0 in 0.703s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Flow 'volume_create_manager' (98868199-7bb7-4748-9602-33c7ef171ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121110df-bd85-4e3e-b798-252617d5d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121110df-bd85-4e3e-b798-252617d5d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-890853080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c15c24-97c2-4e85-aae8-68b6abf6de8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfab1874c6d4f9da051e0949e819ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:29Z,use_quota=True,user_id='60ac854b6623486baaf1d8bb9042e808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db36330e-65ba-48f6-bb27-792c59b9048d),volume_type_id=db36330e-65ba-48f6-bb27-792c59b9048d)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96d37e5-ebc0-44d7-a276-16f32920d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96d37e5-ebc0-44d7-a276-16f32920d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e805501b-674a-49ef-bb4f-1eac6c33090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 09:53:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:29 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 Sep 07 09:53:29 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:30 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4" returned: 0 in 0.420s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87793de0-02f5-4dad-9452-6703807c84eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bfc986-04a5-48b7-b483-25f312421ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:30 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Volume volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 (8b6a5891-edd2-4f58-9f07-5d5053fbccf4): created successfully Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bfc986-04a5-48b7-b483-25f312421ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Flow 'volume_create_manager' (a4581686-1870-47ce-b359-e6600f77f403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-74edf4b1-3393-4007-8dd4-9365d808d6ee tempest-TestInstancesWithCinderVolumes-177735051 None] Created volume successfully. Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e805501b-674a-49ef-bb4f-1eac6c33090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36c15c24-97c2-4e85-aae8-68b6abf6de8c', 'volume_name': 'volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c', 'volume_size': 1, 'image_id': '9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--832573684', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cfab1874c6d4f9da051e0949e819ec8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'created_at': datetime.datetime(2026, 9, 7, 7, 53, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 53, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd/file', 'properties': {}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5e2597-8545-43ac-bc9b-7df662a06f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5e2597-8545-43ac-bc9b-7df662a06f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5176c4-8bda-4d93-86f9-ee878eb313bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:30 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Volume 36c15c24-97c2-4e85-aae8-68b6abf6de8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c', 'volume_size': 1, 'image_id': '9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--832573684', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cfab1874c6d4f9da051e0949e819ec8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'created_at': datetime.datetime(2026, 9, 7, 7, 53, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 53, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd/file', 'properties': {}}, 'image_service': } Sep 07 09:53:30 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Trying to clone 36c15c24-97c2-4e85-aae8-68b6abf6de8c from image 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Flow 'volume_create_manager' (1af8d652-6b75-47fd-8dec-be491cd36843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f42417e-1d9c-4db3-83e8-ed7d3ebdd736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f42417e-1d9c-4db3-83e8-ed7d3ebdd736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-212767316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25cac5bc50640cca7206947c30574fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:32Z,use_quota=True,user_id='82440035755c4933bfd2eec810025b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9e4c10-865e-471b-8a02-8696f0784125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9e4c10-865e-471b-8a02-8696f0784125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07f9cec-a69c-4864-bf0c-59a716c98736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07f9cec-a69c-4864-bf0c-59a716c98736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf', 'volume_name': 'volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60156ea4-f207-428a-86af-4489acb4108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60156ea4-f207-428a-86af-4489acb4108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152c8f93-7d5d-4077-8114-daa87a7fadf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:32 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Volume 1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf', 'volume_size': 1} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-212767316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25cac5bc50640cca7206947c30574fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:32Z,use_quota=True,user_id='82440035755c4933bfd2eec810025b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Creating volume 1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:32 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:32 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf 1073741824 Sep 07 09:53:32 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:33 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf 1073741824" returned: 0 in 0.567s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:33 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf Sep 07 09:53:33 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:33 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" returned: 0 in 0.426s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152c8f93-7d5d-4077-8114-daa87a7fadf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98d9126-622b-4b8a-8abf-9f8bfda0f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:33 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Volume volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf (1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf): created successfully Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98d9126-622b-4b8a-8abf-9f8bfda0f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Flow 'volume_create_manager' (1af8d652-6b75-47fd-8dec-be491cd36843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:33 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-12576b21-d5e5-443c-beff-9d0013a6baa6 req-d5ed0cf0-6ab2-45e3-b019-1516d22b3828 tempest-VolumesSnapshotsTestJSON-893415627 None] Created volume successfully. Sep 07 09:53:34 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD, size 20.69 MB, duration 4.32 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 09:53:34 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Image download 20.69 MB at 4.79 MB/s Sep 07 09:53:34 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719e796-ca38-4753-b566-53565ec52c32]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:35 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD Sep 07 09:53:35 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Creating offline snapshot 4208cea6-322a-48e8-a63f-d6b6105bf250 of volume 1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ad41b8-6017-4de3-ac12-0225cf32c4c2]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:35 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf Sep 07 09:53:35 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:35 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Temporary image 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd is fetched for user 60ac854b6623486baaf1d8bb9042e808. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7df6af-856e-408f-91c6-28c2b7deb901]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:35 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD Sep 07 09:53:35 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:35 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" returned: 0 in 0.745s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:36 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 1G Sep 07 09:53:36 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:36 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:36 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 1G" returned: 0 in 0.485s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:36 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 Sep 07 09:53:36 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:36 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250" returned: 0 in 0.391s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:36 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 is being set with open permissions: ugo+rw Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:36 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 Sep 07 09:53:36 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Flow 'volume_create_manager' (1fab35ba-b093-472c-8729-bf28a4bcee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7457af-39b3-42c4-a2b2-ca156dd9ae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7457af-39b3-42c4-a2b2-ca156dd9ae04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1182276735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658dc0d8-1195-4cd6-b4de-4daf346e18fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb70087aa0594cef867e84bd364c5e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:37Z,use_quota=True,user_id='b1c2da4801c144599ce114c9f8371c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f36eaadb-c292-49ad-94e6-03c027df69af),volume_type_id=f36eaadb-c292-49ad-94e6-03c027df69af)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec02516-70e7-4ee4-a5c2-43c429326cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec02516-70e7-4ee4-a5c2-43c429326cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b2caa9-f052-4e81-9032-aa04b8682b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b2caa9-f052-4e81-9032-aa04b8682b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658dc0d8-1195-4cd6-b4de-4daf346e18fe', 'volume_name': 'volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb2cb5e-4dc6-4df0-8fa3-137992b523ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb2cb5e-4dc6-4df0-8fa3-137992b523ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3ce549-9591-4b12-8024-12b706b13de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:37 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Volume 658dc0d8-1195-4cd6-b4de-4daf346e18fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe', 'volume_size': 1} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:37 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250" returned: 0 in 0.324s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:37 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.info Sep 07 09:53:37 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:37 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.info" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:37 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.info is being set with open permissions: ugo+rw Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:37 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.info Sep 07 09:53:37 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:37 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.info" returned: 0 in 0.254s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-890853080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c15c24-97c2-4e85-aae8-68b6abf6de8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfab1874c6d4f9da051e0949e819ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:29Z,use_quota=True,user_id='60ac854b6623486baaf1d8bb9042e808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db36330e-65ba-48f6-bb27-792c59b9048d),volume_type_id=db36330e-65ba-48f6-bb27-792c59b9048d)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Creating volume 36c15c24-97c2-4e85-aae8-68b6abf6de8c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:37 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:37 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c 1073741824 Sep 07 09:53:37 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-4c3d8b40-76c1-40b7-901d-8780c5588174 req-781d80cc-6ce2-4680-9637-ee697c28a247 tempest-VolumesSnapshotsTestJSON-893415627 None] Create snapshot completed successfully Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "cinder-4208cea6-322a-48e8-a63f-d6b6105bf250-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-4208cea6-322a-48e8-a63f-d6b6105bf250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "cinder-quobyte-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-quobyte-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "cinder-quobyte-4208cea6-322a-48e8-a63f-d6b6105bf250" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:38 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c 1073741824" returned: 0 in 0.716s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-quobyte-4208cea6-322a-48e8-a63f-d6b6105bf250" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Deleting offline snapshot 4208cea6-322a-48e8-a63f-d6b6105bf250 of volume 1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] snapshot_file for this snap is: volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf565d-200f-445c-b56a-fee872cacdc6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:38 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c Sep 07 09:53:38 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:38 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 Sep 07 09:53:38 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:39 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c" returned: 0 in 0.409s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1182276735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658dc0d8-1195-4cd6-b4de-4daf346e18fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb70087aa0594cef867e84bd364c5e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:37Z,use_quota=True,user_id='b1c2da4801c144599ce114c9f8371c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f36eaadb-c292-49ad-94e6-03c027df69af),volume_type_id=f36eaadb-c292-49ad-94e6-03c027df69af)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:39 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Creating volume 658dc0d8-1195-4cd6-b4de-4daf346e18fe {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:39 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250" returned: 0 in 0.495s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:53:39 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe 1073741824 Sep 07 09:53:39 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[df827022-57d1-46ab-b326-a6050079a1cd]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Attempting download of 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd ((None, [{'url': 'file:///opt/stack/data/glance/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'metadata': {}}])) to volume 36c15c24-97c2-4e85-aae8-68b6abf6de8c. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56112e4-59c7-457d-aff4-055dd7de49a1]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_7n31zvfo {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:39 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf Sep 07 09:53:39 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:39 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_7n31zvfo Sep 07 09:53:39 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:39 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:39 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" returned: 0 in 0.465s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:39 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_7n31zvfo" returned: 0 in 0.388s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_7n31zvfo {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe 1073741824" returned: 0 in 0.560s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:39 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 Sep 07 09:53:39 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:39 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe Sep 07 09:53:39 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:39 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_7n31zvfo Sep 07 09:53:39 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:39 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe" returned: 0 in 0.302s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:39 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3ce549-9591-4b12-8024-12b706b13de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091e0e78-a43c-4b97-af04-1e960f75713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:40 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_7n31zvfo" returned: 1 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_7n31zvfo' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2074b39-3088-4665-bc0a-98e28e3bfafe]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Volume volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe (658dc0d8-1195-4cd6-b4de-4daf346e18fe): created successfully Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091e0e78-a43c-4b97-af04-1e960f75713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Flow 'volume_create_manager' (1fab35ba-b093-472c-8729-bf28a4bcee38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:40 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250 Sep 07 09:53:40 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bb957119-25fb-435b-95ae-b71ca6019186 tempest-VolumeTypesAccessTest-2133155206 None] Created volume successfully. Sep 07 09:53:40 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD Sep 07 09:53:40 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:40 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf.4208cea6-322a-48e8-a63f-d6b6105bf250" returned: 0 in 0.307s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-quobyte-4208cea6-322a-48e8-a63f-d6b6105bf250" released by "_delete_snapshot" :: held 1.851s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-quobyte-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" released by "delete_snapshot" :: held 1.902s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:40 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd was qcow2, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.quota [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Created reservations ['1916bee7-cf73-4d24-a9f2-5552efa1cccf', 'b9249a20-4f13-407c-92a7-e3011726eece', 'cafd95b7-7a99-4ae5-bf36-b10ecdb28f8b', '7050ab83-9eac-44ce-9460-1c9763d94e74'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:53:40 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c Sep 07 09:53:40 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Delete snapshot completed successfully. Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-938364eb-d78d-46e8-8914-8cd6e3a40ace req-27ff78a4-abfa-4640-be9a-658c8238754a tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-4208cea6-322a-48e8-a63f-d6b6105bf250-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "cinder-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "cinder-quobyte-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-quobyte-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ff7d3-6789-49da-9ebb-642e6cef0602]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:41 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf Sep 07 09:53:41 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:41 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:41 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Acquiring lock "cinder-658dc0d8-1195-4cd6-b4de-4daf346e18fe-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Lock "cinder-658dc0d8-1195-4cd6-b4de-4daf346e18fe-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:41 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" returned: 0 in 0.576s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:41 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf Sep 07 09:53:41 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Acquiring lock "cinder-quobyte-658dc0d8-1195-4cd6-b4de-4daf346e18fe" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:53:41 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.351s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Lock "cinder-quobyte-658dc0d8-1195-4cd6-b4de-4daf346e18fe" acquired by "delete_volume" :: waited 0.046s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd25c43-20b1-4f09-b065-d52e19bafc09]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:41 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe Sep 07 09:53:41 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:41 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-quobyte-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf" released by "delete_volume" :: held 0.942s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.quota [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Created reservations ['43f59b39-90d4-45f0-9493-f175436e03a2', '69508a2e-078d-41a7-91c1-70198a905626', 'aa865e44-6f0a-4756-8d16-c1b8d403662e', 'ead69fa1-cd23-4f22-987a-c158ee7cf3d3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:41 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:41 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:42 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe" returned: 0 in 0.531s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:42 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe Sep 07 09:53:42 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:42 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.374s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG cinder.manager [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Deleted volume successfully. Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-e47f6771-3e95-424f-b959-d27e1f2d811c req-559ef9ca-a0b0-44dc-a828-6c1ca07b54ed tempest-VolumesSnapshotsTestJSON-893415627 None] Lock "cinder-1323e4ba-d48d-4bd5-a3a9-621ec5c73ebf-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:42 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-658dc0d8-1195-4cd6-b4de-4daf346e18fe" returned: 0 in 0.394s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Lock "cinder-quobyte-658dc0d8-1195-4cd6-b4de-4daf346e18fe" released by "delete_volume" :: held 1.009s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:42 devstack cinder-volume[87290]: WARNING cinder.quota [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1548995322 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1548995322, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:53:42 devstack cinder-volume[87290]: WARNING cinder.quota [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1548995322 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1548995322, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Created reservations ['5032c126-fcaf-48e3-822e-3a6f60ece110', '167d3a9a-bb44-4faf-ba75-dd582c8bdb3c', '18f33575-7d96-4f36-bc08-4aa1760a7f93', 'c6e61196-1f74-428c-b3cc-7992fb08a9c6'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:42 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:53:42 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:42 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c" returned: 0 in 2.433s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd_gt1nleufdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:53:42 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Converted 112.00 MB image at 45.99 MB/s Sep 07 09:53:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:42 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c 1G Sep 07 09:53:42 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:43 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.330s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Deleted volume successfully. Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b55ae090-a318-4724-9a6b-a938b8fcb9da tempest-VolumeTypesAccessTest-2133155206 None] Lock "cinder-658dc0d8-1195-4cd6-b4de-4daf346e18fe-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:53:43 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c 1G" returned: 0 in 0.372s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Downloaded image 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd ((None, [{'url': 'file:///opt/stack/data/glance/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'metadata': {}}])) to volume 36c15c24-97c2-4e85-aae8-68b6abf6de8c successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Temporary image 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd for user 60ac854b6623486baaf1d8bb9042e808 is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Marking volume 36c15c24-97c2-4e85-aae8-68b6abf6de8c as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Copying metadata from image 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd to 36c15c24-97c2-4e85-aae8-68b6abf6de8c. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Creating volume glance metadata for volume 36c15c24-97c2-4e85-aae8-68b6abf6de8c backed by image 9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd with: {'image_id': '9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'image_name': 'tempest-scenario-img--832573684', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5176c4-8bda-4d93-86f9-ee878eb313bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c', 'volume_size': 1, 'image_id': '9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--832573684', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cfab1874c6d4f9da051e0949e819ec8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd', 'created_at': datetime.datetime(2026, 9, 7, 7, 53, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 53, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9772c2ff-c05d-4f5d-bb3c-c6bd585a9efd/file', 'properties': {}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0b0b34-5d7c-47a4-95ba-e16ae2cca3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:43 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Volume volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c (36c15c24-97c2-4e85-aae8-68b6abf6de8c): created successfully Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0b0b34-5d7c-47a4-95ba-e16ae2cca3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Flow 'volume_create_manager' (98868199-7bb7-4748-9602-33c7ef171ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a7fe9fdf-5d40-45a0-a24c-1674365f2324 tempest-TestInstancesWithCinderVolumes-177735051 None] Created volume successfully. Sep 07 09:53:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-3777c741-1835-4316-aab9-0179e7422af4 req-24d93d61-bc1a-4187-adb7-b2628f8859d6 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-3777c741-1835-4316-aab9-0179e7422af4 req-24d93d61-bc1a-4187-adb7-b2628f8859d6 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:47 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=102,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=8 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:53:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-3777c741-1835-4316-aab9-0179e7422af4 req-24d93d61-bc1a-4187-adb7-b2628f8859d6 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-3777c741-1835-4316-aab9-0179e7422af4 req-24d93d61-bc1a-4187-adb7-b2628f8859d6 tempest-TestInstancesWithCinderVolumes-177735051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05787057-fd89-41f6-b809-ad1825e58dbe', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:53:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-3777c741-1835-4316-aab9-0179e7422af4 req-24d93d61-bc1a-4187-adb7-b2628f8859d6 tempest-TestInstancesWithCinderVolumes-177735051 None] attachment_update completed successfully. Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Flow 'volume_create_manager' (a01d5a98-d465-4a8e-ac56-2947c1be9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049ff001-5b8f-4ac7-97c3-166c2cc6df9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049ff001-5b8f-4ac7-97c3-166c2cc6df9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-777072133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c50aaf-3f28-47bb-ac67-808dd098bae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab54cb8d0bd490db3fdb1ab2b09a37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:52Z,use_quota=True,user_id='e9012807bbfa4fc4af89dd545f602552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11ee802-c0ac-4849-8326-b138c08ce9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11ee802-c0ac-4849-8326-b138c08ce9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f6c26d-42d0-410a-89b0-7f69fac34a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f6c26d-42d0-410a-89b0-7f69fac34a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c50aaf-3f28-47bb-ac67-808dd098bae6', 'volume_name': 'volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af49b97-f299-4632-89f2-aa1086d2bb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af49b97-f299-4632-89f2-aa1086d2bb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9335e1b9-e21b-4f53-bd7b-a545c2e950a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:51 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Volume c8c50aaf-3f28-47bb-ac67-808dd098bae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6', 'volume_size': 1} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-777072133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c50aaf-3f28-47bb-ac67-808dd098bae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab54cb8d0bd490db3fdb1ab2b09a37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:52Z,use_quota=True,user_id='e9012807bbfa4fc4af89dd545f602552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Creating volume c8c50aaf-3f28-47bb-ac67-808dd098bae6 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:52 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:52 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 1073741824 Sep 07 09:53:52 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=113,cinder:INSERT=28,cinder:DELETE=10,cinder:SELECT=84 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Flow 'volume_create_manager' (914be81d-41f2-4a60-ab64-cdf8f21e973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbf198b-5906-427e-ad14-0362e8592a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbf198b-5906-427e-ad14-0362e8592a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1633498814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c637727-59e9-401f-90a9-4c6d27ca1bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab54cb8d0bd490db3fdb1ab2b09a37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:52Z,use_quota=True,user_id='e9012807bbfa4fc4af89dd545f602552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0571516-c3d1-4e6d-93bb-a25e1cf862f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0571516-c3d1-4e6d-93bb-a25e1cf862f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0690b7fd-7410-40dd-838f-0731a49df735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0690b7fd-7410-40dd-838f-0731a49df735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c637727-59e9-401f-90a9-4c6d27ca1bb9', 'volume_name': 'volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b939baa1-1759-4d58-82af-ffae1b4e7e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b939baa1-1759-4d58-82af-ffae1b4e7e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48920223-b370-49bd-a44f-78c0bb833f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:52 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Volume 7c637727-59e9-401f-90a9-4c6d27ca1bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9', 'volume_size': 1} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:52 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 1073741824" returned: 0 in 0.659s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:52 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 Sep 07 09:53:52 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:53 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6" returned: 0 in 0.332s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1633498814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c637727-59e9-401f-90a9-4c6d27ca1bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab54cb8d0bd490db3fdb1ab2b09a37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:53:52Z,use_quota=True,user_id='e9012807bbfa4fc4af89dd545f602552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Creating volume 7c637727-59e9-401f-90a9-4c6d27ca1bb9 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:53:53 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9335e1b9-e21b-4f53-bd7b-a545c2e950a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87c39fe-e9d9-4208-a303-d0f3d1f4ca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:53 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 1073741824 Sep 07 09:53:53 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:53 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Volume volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 (c8c50aaf-3f28-47bb-ac67-808dd098bae6): created successfully Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87c39fe-e9d9-4208-a303-d0f3d1f4ca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Flow 'volume_create_manager' (a01d5a98-d465-4a8e-ac56-2947c1be9317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:53 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-612faacc-d71c-4c57-ba24-80d888ccc303 tempest-TestServerVolumeAttachmentScenario-508062559 None] Created volume successfully. Sep 07 09:53:53 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 1073741824" returned: 0 in 0.619s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:53 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 Sep 07 09:53:53 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:54 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9" returned: 0 in 0.372s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:53:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:53:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48920223-b370-49bd-a44f-78c0bb833f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06312ad7-c489-4fe8-99fe-942a13985470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:53:54 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Volume volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 (7c637727-59e9-401f-90a9-4c6d27ca1bb9): created successfully Sep 07 09:53:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06312ad7-c489-4fe8-99fe-942a13985470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:53:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Flow 'volume_create_manager' (914be81d-41f2-4a60-ab64-cdf8f21e973a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:53:54 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-01acdf9c-40f7-4a57-a366-859440c81a6b tempest-TestServerVolumeAttachmentScenario-508062559 None] Created volume successfully. Sep 07 09:54:04 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:54:04 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=1,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:54:15 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Flow 'volume_create_manager' (e734d3ff-023b-440d-947d-7d216a882ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75794d2d-dbdf-4b55-9c30-ff0016e4601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75794d2d-dbdf-4b55-9c30-ff0016e4601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-576707755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7688f81b-7c0c-4667-a130-5d8716b5d729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5c3d91a2004ec2bd8cc69157e258b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:54:16Z,use_quota=True,user_id='36d3ce04e39e4e36a3ea3d662b418275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4b244a-19c9-48d8-bbd7-1e0982922cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4b244a-19c9-48d8-bbd7-1e0982922cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f03411-d855-4504-b398-88083a09905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f03411-d855-4504-b398-88083a09905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7688f81b-7c0c-4667-a130-5d8716b5d729', 'volume_name': 'volume-7688f81b-7c0c-4667-a130-5d8716b5d729', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d276313-5731-4066-9130-190d3dc59dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d276313-5731-4066-9130-190d3dc59dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d161032-62b3-4e0d-9a69-e9971d5b3aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Volume 7688f81b-7c0c-4667-a130-5d8716b5d729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7688f81b-7c0c-4667-a130-5d8716b5d729', 'volume_size': 1} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-576707755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7688f81b-7c0c-4667-a130-5d8716b5d729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5c3d91a2004ec2bd8cc69157e258b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:54:16Z,use_quota=True,user_id='36d3ce04e39e4e36a3ea3d662b418275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Creating volume 7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:54:16 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:16 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 1073741824 Sep 07 09:54:16 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:16 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 1073741824" returned: 0 in 0.782s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:16 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 Sep 07 09:54:17 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:17 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729" returned: 0 in 0.424s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:54:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d161032-62b3-4e0d-9a69-e9971d5b3aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7688f81b-7c0c-4667-a130-5d8716b5d729', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d467b7-178e-4544-abf3-f955c6af25d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:17 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Volume volume-7688f81b-7c0c-4667-a130-5d8716b5d729 (7688f81b-7c0c-4667-a130-5d8716b5d729): created successfully Sep 07 09:54:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d467b7-178e-4544-abf3-f955c6af25d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Flow 'volume_create_manager' (e734d3ff-023b-440d-947d-7d216a882ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:54:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-853813ae-f717-489d-83f2-091042cacd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Created volume successfully. Sep 07 09:54:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Creating offline snapshot 39d67735-0abb-4af6-be4c-3e57fef15a5c of volume 7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:54:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[303d94f6-b58e-4a5b-9f0f-c693ad25eb70]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:18 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 Sep 07 09:54:18 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:18 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729" returned: 0 in 0.377s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:18 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c 1G Sep 07 09:54:18 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Flow 'volume_create_manager' (0fc8751f-1950-4b18-9073-5fc341796c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09985b03-8fb2-4b5a-bef2-6b3bda67fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09985b03-8fb2-4b5a-bef2-6b3bda67fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-655290090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206011f7-3eb1-405e-b5aa-13b37bada73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dd3343a971439e8c163a134eb9f2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:54:19Z,use_quota=True,user_id='e877ead9cc7d4056ba7bb135830f9e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b1f38-699f-44ef-9bae-768ea1f6fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b1f38-699f-44ef-9bae-768ea1f6fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ae65ee-5e73-4838-9182-e1192833796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ae65ee-5e73-4838-9182-e1192833796a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206011f7-3eb1-405e-b5aa-13b37bada73b', 'volume_name': 'volume-206011f7-3eb1-405e-b5aa-13b37bada73b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc25579c-f498-441c-8801-bd9296fc30bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc25579c-f498-441c-8801-bd9296fc30bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2262b1-75af-4891-81fb-6937774d4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:19 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Volume 206011f7-3eb1-405e-b5aa-13b37bada73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206011f7-3eb1-405e-b5aa-13b37bada73b', 'volume_size': 1} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:19 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c 1G" returned: 0 in 0.488s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7688f81b-7c0c-4667-a130-5d8716b5d729 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:19 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7688f81b-7c0c-4667-a130-5d8716b5d729 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c Sep 07 09:54:19 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:19 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7688f81b-7c0c-4667-a130-5d8716b5d729 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c" returned: 0 in 0.290s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:19 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c is being set with open permissions: ugo+rw Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:19 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c Sep 07 09:54:19 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:19 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c" returned: 0 in 0.253s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:19 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.info Sep 07 09:54:19 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:20 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.info" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:20 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.info is being set with open permissions: ugo+rw Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:20 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.info Sep 07 09:54:20 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:20 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.info" returned: 0 in 0.246s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-655290090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206011f7-3eb1-405e-b5aa-13b37bada73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dd3343a971439e8c163a134eb9f2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:54:19Z,use_quota=True,user_id='e877ead9cc7d4056ba7bb135830f9e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Creating volume 206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:54:20 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:20 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b 1073741824 Sep 07 09:54:20 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fa3381e4-20b5-46e9-9638-66ac8d8f98e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Create snapshot completed successfully Sep 07 09:54:20 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b 1073741824" returned: 0 in 0.415s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:20 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b Sep 07 09:54:20 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:21 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2262b1-75af-4891-81fb-6937774d4a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206011f7-3eb1-405e-b5aa-13b37bada73b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3792d2ae-bbef-4893-a8c9-1d418cef887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Volume volume-206011f7-3eb1-405e-b5aa-13b37bada73b (206011f7-3eb1-405e-b5aa-13b37bada73b): created successfully Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3792d2ae-bbef-4893-a8c9-1d418cef887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Flow 'volume_create_manager' (0fc8751f-1950-4b18-9073-5fc341796c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:54:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a9a24d1a-f3ea-4a7e-8abe-52762096ed0a tempest-SnapshotMetadataTestJSON-575057656 None] Created volume successfully. Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Creating offline snapshot 6e0a9ff7-0fe7-4952-8c9c-04203908f474 of volume 206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fbc6bf-ad84-43c3-b3af-11d0d9bb6d05]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:21 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b Sep 07 09:54:21 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "cinder-39d67735-0abb-4af6-be4c-3e57fef15a5c-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:22 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b" returned: 0 in 0.429s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:22 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 1G Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-39d67735-0abb-4af6-be4c-3e57fef15a5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:22 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "cinder-quobyte-7688f81b-7c0c-4667-a130-5d8716b5d729" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-quobyte-7688f81b-7c0c-4667-a130-5d8716b5d729" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "cinder-quobyte-39d67735-0abb-4af6-be4c-3e57fef15a5c" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-quobyte-39d67735-0abb-4af6-be4c-3e57fef15a5c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Deleting offline snapshot 39d67735-0abb-4af6-be4c-3e57fef15a5c of volume 7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] snapshot_file for this snap is: volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7235ae32-ca93-4850-b56f-cc8ddeeb0a3f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:22 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c Sep 07 09:54:22 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:22 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 1G" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-206011f7-3eb1-405e-b5aa-13b37bada73b -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:22 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-206011f7-3eb1-405e-b5aa-13b37bada73b -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 Sep 07 09:54:22 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:22 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c" returned: 0 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7688f81b-7c0c-4667-a130-5d8716b5d729(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e687502b-d6fc-47cd-a768-5704af8c1f46]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:22 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 Sep 07 09:54:22 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:22 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-206011f7-3eb1-405e-b5aa-13b37bada73b -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474" returned: 0 in 0.313s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:22 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 is being set with open permissions: ugo+rw Sep 07 09:54:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:22 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 Sep 07 09:54:22 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:23 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729" returned: 0 in 0.444s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:23 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c Sep 07 09:54:23 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:23 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474" returned: 0 in 0.363s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:23 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.info Sep 07 09:54:23 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:23 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c" returned: 0 in 0.434s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:23 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.info" returned: 0 in 0.307s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:23 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.info is being set with open permissions: ugo+rw Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:23 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c Sep 07 09:54:23 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:23 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.info Sep 07 09:54:23 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:23 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729.39d67735-0abb-4af6-be4c-3e57fef15a5c" returned: 0 in 0.317s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-quobyte-39d67735-0abb-4af6-be4c-3e57fef15a5c" released by "_delete_snapshot" :: held 1.748s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:23 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.info" returned: 0 in 0.355s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-quobyte-7688f81b-7c0c-4667-a130-5d8716b5d729" released by "delete_snapshot" :: held 1.796s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f2707dba-c89d-402b-be99-906b4374702f tempest-SnapshotMetadataTestJSON-575057656 None] Create snapshot completed successfully Sep 07 09:54:23 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Created reservations ['0d818e57-8855-4b03-a2d0-4bee92a8a873', '12bd9e53-a955-4f57-a329-eb3ded97fb37', '6124ce86-e9fd-40ef-a6c2-1e8e7ccd614c', '68fb0c7a-c2d5-4c1e-ab83-3f34fe955b8b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:24 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Delete snapshot completed successfully. Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b01fa76e-1c39-4d21-98f2-0db9123f5c83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-39d67735-0abb-4af6-be4c-3e57fef15a5c-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "cinder-7688f81b-7c0c-4667-a130-5d8716b5d729-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-7688f81b-7c0c-4667-a130-5d8716b5d729-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "cinder-quobyte-7688f81b-7c0c-4667-a130-5d8716b5d729" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-quobyte-7688f81b-7c0c-4667-a130-5d8716b5d729" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b640861d-1d4e-4283-b038-91a35d45f1d9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:24 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 Sep 07 09:54:24 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:24 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729" returned: 0 in 0.500s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:24 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729 Sep 07 09:54:24 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:25 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7688f81b-7c0c-4667-a130-5d8716b5d729" returned: 0 in 0.360s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-quobyte-7688f81b-7c0c-4667-a130-5d8716b5d729" released by "delete_volume" :: held 0.925s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Created reservations ['cf2d42ae-4038-4ba4-ab2d-2d7eeb5a0e7e', '8f4e29ae-4b0b-4405-86f9-2d0febf98bd0', '36f2a949-72c7-4637-ab86-fc3f694168c7', '78848297-9cb7-459e-9d9e-5390665a03de'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:25 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:54:25 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "cinder-6e0a9ff7-0fe7-4952-8c9c-04203908f474-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-6e0a9ff7-0fe7-4952-8c9c-04203908f474-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "cinder-quobyte-206011f7-3eb1-405e-b5aa-13b37bada73b" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-quobyte-206011f7-3eb1-405e-b5aa-13b37bada73b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "cinder-quobyte-6e0a9ff7-0fe7-4952-8c9c-04203908f474" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-quobyte-6e0a9ff7-0fe7-4952-8c9c-04203908f474" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Deleting offline snapshot 6e0a9ff7-0fe7-4952-8c9c-04203908f474 of volume 206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] snapshot_file for this snap is: volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[851817ce-ac28-41f3-bb1e-5ac8bb0ede84]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:25 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.377s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Deleted volume successfully. Sep 07 09:54:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f1e7a888-c86f-437f-beee-0229e18cc032 tempest-VolumeSnapshotQuotasNegativeTestJSON-1093318650 None] Lock "cinder-7688f81b-7c0c-4667-a130-5d8716b5d729-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:25 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 Sep 07 09:54:25 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:26 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474" returned: 0 in 0.496s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-206011f7-3eb1-405e-b5aa-13b37bada73b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:54:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e59d43f-5b18-45f9-a55c-4248e5d6203b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:26 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b Sep 07 09:54:26 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:26 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b" returned: 0 in 0.402s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:26 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 Sep 07 09:54:26 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:27 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474" returned: 0 in 0.393s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:27 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474 Sep 07 09:54:27 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:27 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b.6e0a9ff7-0fe7-4952-8c9c-04203908f474" returned: 0 in 0.324s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-quobyte-6e0a9ff7-0fe7-4952-8c9c-04203908f474" released by "_delete_snapshot" :: held 1.758s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-quobyte-206011f7-3eb1-405e-b5aa-13b37bada73b" released by "delete_snapshot" :: held 1.786s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Created reservations ['8b13a032-efe7-412e-879e-8c2907fb9dd7', '8201667a-c68a-4b24-9493-87d12add89e4', '24f49710-ebab-4b05-8e64-98337bdf7bc1', 'fc4e1b98-cc81-4972-86e5-40ef99566fdb'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Delete snapshot completed successfully. Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-699ac6d7-7741-486a-87bd-2ffde55b3ba4 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-6e0a9ff7-0fe7-4952-8c9c-04203908f474-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-3eaa4e1f-93ad-44f9-ad9f-2aaa5afcf6de req-8417c7b7-e3c7-46b4-9ea0-f7626ff64374 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-3eaa4e1f-93ad-44f9-ad9f-2aaa5afcf6de req-8417c7b7-e3c7-46b4-9ea0-f7626ff64374 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-3eaa4e1f-93ad-44f9-ad9f-2aaa5afcf6de req-8417c7b7-e3c7-46b4-9ea0-f7626ff64374 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "cinder-206011f7-3eb1-405e-b5aa-13b37bada73b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-3eaa4e1f-93ad-44f9-ad9f-2aaa5afcf6de req-8417c7b7-e3c7-46b4-9ea0-f7626ff64374 tempest-TestInstancesWithCinderVolumes-177735051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52e7794a-4dd0-49eb-b296-4ac9bc67b2d9', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-206011f7-3eb1-405e-b5aa-13b37bada73b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "cinder-quobyte-206011f7-3eb1-405e-b5aa-13b37bada73b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-3eaa4e1f-93ad-44f9-ad9f-2aaa5afcf6de req-8417c7b7-e3c7-46b4-9ea0-f7626ff64374 tempest-TestInstancesWithCinderVolumes-177735051 None] attachment_update completed successfully. Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-quobyte-206011f7-3eb1-405e-b5aa-13b37bada73b" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab70a6-bf2c-4395-848c-35636aab5613]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:28 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b Sep 07 09:54:28 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:28 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b" returned: 0 in 0.494s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:28 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b Sep 07 09:54:28 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:28 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-206011f7-3eb1-405e-b5aa-13b37bada73b" returned: 0 in 0.266s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-quobyte-206011f7-3eb1-405e-b5aa-13b37bada73b" released by "delete_volume" :: held 0.840s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Created reservations ['80f3385f-b8e2-4ca2-a096-e37036367221', 'd480dbe5-8cde-4d73-9a58-d2a12b49659f', 'dd9d559b-aa5b-42e4-a848-b20a0d6ff9ca', '39aee0e8-39aa-4e44-b384-d774bd4e9b31'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:29 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:54:29 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:29 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Deleted volume successfully. Sep 07 09:54:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-35d195ed-036d-4455-8848-098d4337f213 tempest-SnapshotMetadataTestJSON-575057656 None] Lock "cinder-206011f7-3eb1-405e-b5aa-13b37bada73b-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a3ad2b19-8b93-47f6-9f41-0bb6dd785aec req-1c772120-1804-41f9-b27f-a7c837584597 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a3ad2b19-8b93-47f6-9f41-0bb6dd785aec req-1c772120-1804-41f9-b27f-a7c837584597 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a3ad2b19-8b93-47f6-9f41-0bb6dd785aec req-1c772120-1804-41f9-b27f-a7c837584597 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a3ad2b19-8b93-47f6-9f41-0bb6dd785aec req-1c772120-1804-41f9-b27f-a7c837584597 tempest-TestInstancesWithCinderVolumes-177735051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c698151-bdee-419e-a502-fe60515c92d1', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:54:31 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-a3ad2b19-8b93-47f6-9f41-0bb6dd785aec req-1c772120-1804-41f9-b27f-a7c837584597 tempest-TestInstancesWithCinderVolumes-177735051 None] attachment_update completed successfully. Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Flow 'volume_create_manager' (e9c36cb1-b861-402b-9e45-ca967120e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3eb3b-a95d-4ee6-880c-65d1d2096550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3eb3b-a95d-4ee6-880c-65d1d2096550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1145750055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f80337-5d44-4ee6-b3f5-d5903943af15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23038e55a1b40aea273ea9dcd77b0ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:54:35Z,use_quota=True,user_id='90442c0de23f43a5afc398ab25af78b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c116de-a551-4d88-baa8-9a3c7f23f664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c116de-a551-4d88-baa8-9a3c7f23f664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d281a6c5-c4c9-4938-879b-8aef7475f494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d281a6c5-c4c9-4938-879b-8aef7475f494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f80337-5d44-4ee6-b3f5-d5903943af15', 'volume_name': 'volume-10f80337-5d44-4ee6-b3f5-d5903943af15', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a610bbb-d97a-4da2-ad76-fc7c20c05f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a610bbb-d97a-4da2-ad76-fc7c20c05f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c36fb2e-49c3-485a-818b-c3e72b46e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Volume 10f80337-5d44-4ee6-b3f5-d5903943af15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f80337-5d44-4ee6-b3f5-d5903943af15', 'volume_size': 1} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1145750055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f80337-5d44-4ee6-b3f5-d5903943af15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23038e55a1b40aea273ea9dcd77b0ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:54:35Z,use_quota=True,user_id='90442c0de23f43a5afc398ab25af78b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Creating volume 10f80337-5d44-4ee6-b3f5-d5903943af15 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:54:35 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:35 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 1073741824 Sep 07 09:54:35 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:35 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 1073741824" returned: 0 in 0.510s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:35 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 Sep 07 09:54:35 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:36 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15" returned: 0 in 0.325s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:54:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c36fb2e-49c3-485a-818b-c3e72b46e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f80337-5d44-4ee6-b3f5-d5903943af15', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9380f50-e3c1-4a8f-8c30-488956ae5f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:54:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Volume volume-10f80337-5d44-4ee6-b3f5-d5903943af15 (10f80337-5d44-4ee6-b3f5-d5903943af15): created successfully Sep 07 09:54:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9380f50-e3c1-4a8f-8c30-488956ae5f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:54:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Flow 'volume_create_manager' (e9c36cb1-b861-402b-9e45-ca967120e375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:54:36 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-26394509-7a58-49e9-b2d5-7d79bb2c362f tempest-AbsoluteLimitsTests-1558831348 None] Created volume successfully. Sep 07 09:54:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-5d21d8d8-3620-4fb7-8268-aedd788ed0ff req-c5731d45-02b7-4168-a7e7-e7cf6f28606e tempest-TestInstancesWithCinderVolumes-177735051 None] Terminate volume connection completed successfully. Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-5d21d8d8-3620-4fb7-8268-aedd788ed0ff req-c5731d45-02b7-4168-a7e7-e7cf6f28606e tempest-TestInstancesWithCinderVolumes-177735051 None] Deleting attachment 52e7794a-4dd0-49eb-b296-4ac9bc67b2d9. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "cinder-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "cinder-quobyte-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-quobyte-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46059da-86a5-4c57-b578-f791707986eb]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d1385f94-2dbb-4935-94c3-737a1b49504c req-de129487-6780-4130-8009-93abb970a527 tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d1385f94-2dbb-4935-94c3-737a1b49504c req-de129487-6780-4130-8009-93abb970a527 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d1385f94-2dbb-4935-94c3-737a1b49504c req-de129487-6780-4130-8009-93abb970a527 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Acquiring lock "cinder-10f80337-5d44-4ee6-b3f5-d5903943af15-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Lock "cinder-10f80337-5d44-4ee6-b3f5-d5903943af15-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-d1385f94-2dbb-4935-94c3-737a1b49504c req-de129487-6780-4130-8009-93abb970a527 tempest-TestServerVolumeAttachmentScenario-508062559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff55dc85-110a-435d-a5f5-5a7af6f5ba83', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Acquiring lock "cinder-quobyte-10f80337-5d44-4ee6-b3f5-d5903943af15" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:37 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be Sep 07 09:54:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Lock "cinder-quobyte-10f80337-5d44-4ee6-b3f5-d5903943af15" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:37 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a0f589-7f37-423e-aab2-c9c4c8305680]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-d1385f94-2dbb-4935-94c3-737a1b49504c req-de129487-6780-4130-8009-93abb970a527 tempest-TestServerVolumeAttachmentScenario-508062559 None] attachment_update completed successfully. Sep 07 09:54:38 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 Sep 07 09:54:38 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:38 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be" returned: 0 in 0.604s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:38 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be Sep 07 09:54:38 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:38 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15" returned: 0 in 0.593s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:38 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15 Sep 07 09:54:38 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:38 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-quobyte-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be" released by "delete_volume" :: held 1.107s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:38 devstack cinder-volume[87290]: WARNING cinder.quota [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50360746-1019606349 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50360746-1019606349, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:54:38 devstack cinder-volume[87290]: WARNING cinder.quota [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50360746-1019606349 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50360746-1019606349, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:54:38 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Created reservations ['f16de7a8-b879-46d3-86f3-4ec9988f1361', '76c12ded-c4cf-4fe9-95b5-ce8c9c3dd8ad', 'd11164d4-8ca7-42d8-bdf2-112653170061', '0f7a7634-c786-4805-99ac-319f0dad9667'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:39 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10f80337-5d44-4ee6-b3f5-d5903943af15" returned: 0 in 0.438s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Lock "cinder-quobyte-10f80337-5d44-4ee6-b3f5-d5903943af15" released by "delete_volume" :: held 1.100s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:39 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:54:39 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Created reservations ['d26e5fad-f225-4ac9-a5cb-f8cff23887a0', '7e36db10-379e-4d28-8cad-07ff072f8333', '399fa571-375c-4911-aa76-76dc17893b1b', 'b0aed556-3e8a-4d24-b38a-c247a6081f53'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:39 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:54:39 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:39 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.345s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Deleted volume successfully. Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-eac94720-8713-4b58-928b-65919a419d63 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-64308cfb-9b6d-4ec8-a7d5-f2837d0fd4be-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:39 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.286s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Deleted volume successfully. Sep 07 09:54:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7d8470aa-317b-4544-bd14-e8532278ee64 tempest-AbsoluteLimitsTests-1558831348 None] Lock "cinder-10f80337-5d44-4ee6-b3f5-d5903943af15-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:41 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:54:41 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:41 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.401s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:54:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:54:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-9b05d2bb-5435-4d4c-b920-94050bfe3e0a req-e5bd5fd2-7700-423d-892d-a42858f0d9ed tempest-TestInstancesWithCinderVolumes-177735051 None] Terminate volume connection completed successfully. Sep 07 09:54:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-9b05d2bb-5435-4d4c-b920-94050bfe3e0a req-e5bd5fd2-7700-423d-892d-a42858f0d9ed tempest-TestInstancesWithCinderVolumes-177735051 None] Deleting attachment 5c698151-bdee-419e-a502-fe60515c92d1. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:54:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "cinder-8b6a5891-edd2-4f58-9f07-5d5053fbccf4-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-8b6a5891-edd2-4f58-9f07-5d5053fbccf4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "cinder-quobyte-8b6a5891-edd2-4f58-9f07-5d5053fbccf4" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-quobyte-8b6a5891-edd2-4f58-9f07-5d5053fbccf4" acquired by "delete_volume" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512ebf8-5305-42d0-a825-328a0083c742]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:43 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 Sep 07 09:54:43 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4" returned: 0 in 0.492s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:43 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:43 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4 Sep 07 09:54:43 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:43 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8b6a5891-edd2-4f58-9f07-5d5053fbccf4" returned: 0 in 0.484s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-quobyte-8b6a5891-edd2-4f58-9f07-5d5053fbccf4" released by "delete_volume" :: held 1.054s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:44 devstack cinder-volume[87290]: WARNING cinder.quota [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-154259268-1912906991 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-154259268-1912906991, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:54:44 devstack cinder-volume[87290]: WARNING cinder.quota [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-154259268-1912906991 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-154259268-1912906991, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Created reservations ['47cd9e21-a3d9-43b3-8e46-5316941dca63', '704f637c-94e8-4a66-b417-42f66112fd4f', '2f1412c5-c361-4f18-b84d-0bd5241e7b28', '8c8527ff-9e66-4382-a9a3-e87c722b80cd'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:44 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:54:44 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:44 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.314s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Deleted volume successfully. Sep 07 09:54:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-06c8b2d1-624f-4545-a4b1-07586fd4a6c9 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-8b6a5891-edd2-4f58-9f07-5d5053fbccf4-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-2f5548f7-b07d-44f9-a1a2-fa912aeb2c05 req-ad00ab17-d876-440a-b516-f6544a284526 tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-2f5548f7-b07d-44f9-a1a2-fa912aeb2c05 req-ad00ab17-d876-440a-b516-f6544a284526 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-2f5548f7-b07d-44f9-a1a2-fa912aeb2c05 req-ad00ab17-d876-440a-b516-f6544a284526 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-2f5548f7-b07d-44f9-a1a2-fa912aeb2c05 req-ad00ab17-d876-440a-b516-f6544a284526 tempest-TestServerVolumeAttachmentScenario-508062559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5634a14-6a18-41aa-8f54-7ea1f88b3971', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:54:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-2f5548f7-b07d-44f9-a1a2-fa912aeb2c05 req-ad00ab17-d876-440a-b516-f6544a284526 tempest-TestServerVolumeAttachmentScenario-508062559 None] attachment_update completed successfully. Sep 07 09:54:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-11d8363d-d12f-4ecf-913f-b094048aa6df req-f6546f87-ffbd-4193-bc4d-c54510683d9b tempest-TestServerVolumeAttachmentScenario-508062559 None] Terminate volume connection completed successfully. Sep 07 09:54:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-11d8363d-d12f-4ecf-913f-b094048aa6df req-f6546f87-ffbd-4193-bc4d-c54510683d9b tempest-TestServerVolumeAttachmentScenario-508062559 None] Deleting attachment e5634a14-6a18-41aa-8f54-7ea1f88b3971. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:54:49 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-69055b9e-2504-4cd2-8ea2-1f032673c711 req-862e3413-f71e-4643-b397-03f308246271 tempest-TestServerVolumeAttachmentScenario-508062559 None] Terminate volume connection completed successfully. Sep 07 09:54:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-69055b9e-2504-4cd2-8ea2-1f032673c711 req-862e3413-f71e-4643-b397-03f308246271 tempest-TestServerVolumeAttachmentScenario-508062559 None] Deleting attachment ff55dc85-110a-435d-a5f5-5a7af6f5ba83. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:54:50 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-ecbd0b6d-c9b3-4da3-84ca-bb044da70f89 req-5e47b3b5-4a01-4738-9604-b18e19ae80f5 tempest-TestInstancesWithCinderVolumes-177735051 None] Terminate volume connection completed successfully. Sep 07 09:54:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-ecbd0b6d-c9b3-4da3-84ca-bb044da70f89 req-5e47b3b5-4a01-4738-9604-b18e19ae80f5 tempest-TestInstancesWithCinderVolumes-177735051 None] Deleting attachment 05787057-fd89-41f6-b809-ad1825e58dbe. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "cinder-36c15c24-97c2-4e85-aae8-68b6abf6de8c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-36c15c24-97c2-4e85-aae8-68b6abf6de8c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "cinder-quobyte-36c15c24-97c2-4e85-aae8-68b6abf6de8c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-quobyte-36c15c24-97c2-4e85-aae8-68b6abf6de8c" acquired by "delete_volume" :: waited 0.045s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd1e064-197e-4dda-9f58-427c8979a6cf]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:52 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c Sep 07 09:54:52 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:52 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c" returned: 0 in 0.451s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:52 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c Sep 07 09:54:52 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:52 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-36c15c24-97c2-4e85-aae8-68b6abf6de8c" returned: 0 in 0.286s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-quobyte-36c15c24-97c2-4e85-aae8-68b6abf6de8c" released by "delete_volume" :: held 0.795s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:54:53 devstack cinder-volume[87290]: WARNING cinder.quota [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430693834-185749856 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430693834-185749856, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:54:53 devstack cinder-volume[87290]: WARNING cinder.quota [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430693834-185749856 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-430693834-185749856, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Created reservations ['3cdcaabe-5ed9-4837-a85d-33c94f75cb96', 'a56df0e0-a143-45ce-a7c0-1f268717287d', '2a746a37-3792-4ad6-999e-5566c983784f', '0dab7c01-76a4-4f5d-bd53-14961852e667'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:53 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:54:53 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:53 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.349s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:53 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Deleted volume successfully. Sep 07 09:54:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f98acc8-76c7-4c9b-898c-607fa56ca691 tempest-TestInstancesWithCinderVolumes-177735051 None] Lock "cinder-36c15c24-97c2-4e85-aae8-68b6abf6de8c-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:02 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:55:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Flow 'volume_create_manager' (d3eac129-1d39-45c4-bcd9-507b389fb037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:55:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a158385d-95a0-402b-8640-5cf8bf7aa743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a158385d-95a0-402b-8640-5cf8bf7aa743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-395755613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f9eece-0e2a-4408-821f-dcb95b1c4af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a20c2e380e940cb93071a57704bc8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:55:03Z,use_quota=True,user_id='8f1aed7c3bf4414e8ae15d691eb0632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a198fb83-1309-42d7-927f-9050d21c07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a198fb83-1309-42d7-927f-9050d21c07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91938041-cc2b-4f87-a9bd-169e82e4ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91938041-cc2b-4f87-a9bd-169e82e4ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f9eece-0e2a-4408-821f-dcb95b1c4af5', 'volume_name': 'volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654e271e-66e5-4c81-8119-cbf07783e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654e271e-66e5-4c81-8119-cbf07783e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489d2e21-bf52-433e-b7c2-aee3a3239de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Volume 66f9eece-0e2a-4408-821f-dcb95b1c4af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5', 'volume_size': 1} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-395755613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f9eece-0e2a-4408-821f-dcb95b1c4af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a20c2e380e940cb93071a57704bc8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:55:03Z,use_quota=True,user_id='8f1aed7c3bf4414e8ae15d691eb0632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Creating volume 66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:55:03 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:03 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 1073741824 Sep 07 09:55:03 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:03 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 1073741824" returned: 0 in 0.528s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:03 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:55:03 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:03 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.287s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489d2e21-bf52-433e-b7c2-aee3a3239de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6752052-0b37-43d0-b298-b2983653f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Volume volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 (66f9eece-0e2a-4408-821f-dcb95b1c4af5): created successfully Sep 07 09:55:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6752052-0b37-43d0-b298-b2983653f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Flow 'volume_create_manager' (d3eac129-1d39-45c4-bcd9-507b389fb037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:55:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2f3a13e0-1bee-46c9-af49-9131a328a0de tempest-VolumesActionsTest-1603755633 None] Created volume successfully. Sep 07 09:55:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "cinder-7c637727-59e9-401f-90a9-4c6d27ca1bb9-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-7c637727-59e9-401f-90a9-4c6d27ca1bb9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "cinder-quobyte-7c637727-59e9-401f-90a9-4c6d27ca1bb9" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-quobyte-7c637727-59e9-401f-90a9-4c6d27ca1bb9" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be618dc-f87c-4ff2-88df-34b672e91fc0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:07 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 Sep 07 09:55:07 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:07 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9" returned: 0 in 0.446s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:07 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9 Sep 07 09:55:07 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:07 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7c637727-59e9-401f-90a9-4c6d27ca1bb9" returned: 0 in 0.288s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-quobyte-7c637727-59e9-401f-90a9-4c6d27ca1bb9" released by "delete_volume" :: held 0.804s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:07 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Created reservations ['f348f1bf-1de3-4d4b-8d2a-249578f6244b', '98aaf075-f640-47d6-9e2b-e80d55c526fb', '58c494ca-277c-4f48-9b2e-553b8d498405', '51e0d1d1-e1ea-493d-9e33-ed2915e8249e'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:08 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:55:08 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "cinder-c8c50aaf-3f28-47bb-ac67-808dd098bae6-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-c8c50aaf-3f28-47bb-ac67-808dd098bae6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "cinder-quobyte-c8c50aaf-3f28-47bb-ac67-808dd098bae6" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-quobyte-c8c50aaf-3f28-47bb-ac67-808dd098bae6" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c125f3a8-db59-4d21-b2d8-b1adb0c0a4b7]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:08 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.362s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:55:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Deleted volume successfully. Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46c3b78b-ca3e-4792-8cfc-45e74ab682fc tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-7c637727-59e9-401f-90a9-4c6d27ca1bb9-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:08 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 Sep 07 09:55:08 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:08 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:08 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6 Sep 07 09:55:08 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:09 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8c50aaf-3f28-47bb-ac67-808dd098bae6" returned: 0 in 0.330s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-quobyte-c8c50aaf-3f28-47bb-ac67-808dd098bae6" released by "delete_volume" :: held 0.868s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Created reservations ['4d060a0a-23e3-46ac-8046-e702d2efe0de', 'd2a049b8-bf54-4238-9789-e57f3831fc5e', 'fe1ac3c0-134d-4ef4-981c-fae2040eec71', '93d899e6-36e9-4a74-ae64-22a7dd51e3cc'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:09 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:55:09 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:09 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.288s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:55:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Deleted volume successfully. Sep 07 09:55:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4854bcf-3d20-495c-964b-9426d5d21094 tempest-TestServerVolumeAttachmentScenario-508062559 None] Lock "cinder-c8c50aaf-3f28-47bb-ac67-808dd098bae6-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:19 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=104,cinder:SELECT=101,cinder:INSERT=24,cinder:DELETE=4 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:55:19 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=94,cinder:UPDATE=89,cinder:DELETE=10,cinder:INSERT=22 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:55:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dc8b8d55-677f-438c-8e83-8e9a346af1ea tempest-VolumesActionsTest-1603755633 None] Acquiring lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5" by "attach_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dc8b8d55-677f-438c-8e83-8e9a346af1ea tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5" acquired by "attach_volume" :: waited 0.044s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-dc8b8d55-677f-438c-8e83-8e9a346af1ea tempest-VolumesActionsTest-1603755633 None] Attaching volume 66f9eece-0e2a-4408-821f-dcb95b1c4af5 to instance a2347126-c07e-4fae-ba9f-578806a0f31d at mountpoint /dev/vdb on host None. Sep 07 09:55:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-dc8b8d55-677f-438c-8e83-8e9a346af1ea tempest-VolumesActionsTest-1603755633 None] Attach volume completed successfully. Sep 07 09:55:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-dc8b8d55-677f-438c-8e83-8e9a346af1ea tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5" released by "attach_volume" :: held 0.396s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c68b3d7d-2a95-4fe4-b4a9-14dd35d36bba tempest-VolumesActionsTest-1603755633 None] Acquiring lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-detach_volume" by "detach_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c68b3d7d-2a95-4fe4-b4a9-14dd35d36bba tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c68b3d7d-2a95-4fe4-b4a9-14dd35d36bba tempest-VolumesActionsTest-1603755633 None] Detaching volume 66f9eece-0e2a-4408-821f-dcb95b1c4af5 from instance a2347126-c07e-4fae-ba9f-578806a0f31d. Sep 07 09:55:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c68b3d7d-2a95-4fe4-b4a9-14dd35d36bba tempest-VolumesActionsTest-1603755633 None] Detach volume completed successfully. Sep 07 09:55:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c68b3d7d-2a95-4fe4-b4a9-14dd35d36bba tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:40 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:INSERT=2,cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:55:40 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:41 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:55:41 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (26c5531e-6f9b-4b49-8ad7-3a6338bca5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de6bf4a-1640-452d-b18b-036d8e142113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de6bf4a-1640-452d-b18b-036d8e142113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275292293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0485bdb-c6df-455e-b93d-6a6e13f874d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:55:41Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea864e1-a7bd-4c91-b41c-009b616c895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea864e1-a7bd-4c91-b41c-009b616c895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fa6955-85f5-46da-880a-674738c2cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fa6955-85f5-46da-880a-674738c2cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0485bdb-c6df-455e-b93d-6a6e13f874d8', 'volume_name': 'volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f4ccd6-c7c8-4a42-a535-78bb41e15997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f4ccd6-c7c8-4a42-a535-78bb41e15997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb4a4ff-acf7-41fe-982c-60451e86998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:41 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Volume e0485bdb-c6df-455e-b93d-6a6e13f874d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8', 'volume_size': 1} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275292293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0485bdb-c6df-455e-b93d-6a6e13f874d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:55:41Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Creating volume e0485bdb-c6df-455e-b93d-6a6e13f874d8 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:55:41 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:41 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.536s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:55:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:55:41 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 1073741824 Sep 07 09:55:41 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:42 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 1073741824" returned: 0 in 0.855s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:42 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 Sep 07 09:55:42 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:43 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb4a4ff-acf7-41fe-982c-60451e86998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fedc50b-3fd0-4263-bd20-fcfc17bc82b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:43 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Volume volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 (e0485bdb-c6df-455e-b93d-6a6e13f874d8): created successfully Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fedc50b-3fd0-4263-bd20-fcfc17bc82b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (26c5531e-6f9b-4b49-8ad7-3a6338bca5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:55:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0dd36fa3-13cb-49b1-bdef-2e265f273cd6 tempest-VolumesActionsTest-955477661 None] Created volume successfully. Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2a216ce2-4b3f-42b8-9ef7-f1c15cd96f1b tempest-VolumesActionsTest-955477661 None] Acquiring lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8" by "attach_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2a216ce2-4b3f-42b8-9ef7-f1c15cd96f1b tempest-VolumesActionsTest-955477661 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8" acquired by "attach_volume" :: waited 0.039s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2a216ce2-4b3f-42b8-9ef7-f1c15cd96f1b tempest-VolumesActionsTest-955477661 None] Attaching volume e0485bdb-c6df-455e-b93d-6a6e13f874d8 to instance 433c0b07-a9a2-427e-8887-28f9e58a6607 at mountpoint /dev/vdb on host None. Sep 07 09:55:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2a216ce2-4b3f-42b8-9ef7-f1c15cd96f1b tempest-VolumesActionsTest-955477661 None] Attach volume completed successfully. Sep 07 09:55:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2a216ce2-4b3f-42b8-9ef7-f1c15cd96f1b tempest-VolumesActionsTest-955477661 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8" released by "attach_volume" :: held 0.214s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-349c449c-5a00-409a-a484-baa4fbe3421c tempest-VolumesActionsTest-249339574 None] Terminate volume connection completed successfully. Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-349c449c-5a00-409a-a484-baa4fbe3421c tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-detach_volume" by "detach_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-349c449c-5a00-409a-a484-baa4fbe3421c tempest-VolumesActionsTest-249339574 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-349c449c-5a00-409a-a484-baa4fbe3421c tempest-VolumesActionsTest-249339574 None] Detaching volume e0485bdb-c6df-455e-b93d-6a6e13f874d8 from instance 433c0b07-a9a2-427e-8887-28f9e58a6607. Sep 07 09:55:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-349c449c-5a00-409a-a484-baa4fbe3421c tempest-VolumesActionsTest-249339574 None] Detach volume completed successfully. Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-349c449c-5a00-409a-a484-baa4fbe3421c tempest-VolumesActionsTest-249339574 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-61db9f96-1d56-4943-a749-9d4d46b8e498 tempest-VolumesActionsTest-955477661 None] Acquiring lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-detach_volume" by "detach_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-61db9f96-1d56-4943-a749-9d4d46b8e498 tempest-VolumesActionsTest-955477661 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-61db9f96-1d56-4943-a749-9d4d46b8e498 tempest-VolumesActionsTest-955477661 None] Volume detach called, but volume not attached. Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-61db9f96-1d56-4943-a749-9d4d46b8e498 tempest-VolumesActionsTest-955477661 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Acquiring lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Acquiring lock "cinder-quobyte-e0485bdb-c6df-455e-b93d-6a6e13f874d8" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Lock "cinder-quobyte-e0485bdb-c6df-455e-b93d-6a6e13f874d8" acquired by "delete_volume" :: waited 0.054s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0479ed43-de0e-4849-b260-6b6d05a52aaa]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:55:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:46 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 Sep 07 09:55:46 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8" returned: 0 in 0.701s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:46 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:46 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8 Sep 07 09:55:46 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:47 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e0485bdb-c6df-455e-b93d-6a6e13f874d8" returned: 0 in 0.508s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Lock "cinder-quobyte-e0485bdb-c6df-455e-b93d-6a6e13f874d8" released by "delete_volume" :: held 1.313s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Created reservations ['37f038c5-6e99-4640-924f-7cfced78c3ba', '3c62d387-76e2-4034-a27f-d7535330272a', '94f87427-f6c5-425f-a4f4-08fce833853a', '26e9afb8-883c-44b9-bc52-52445822f994'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:47 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:55:47 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:47 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.363s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:55:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Deleted volume successfully. Sep 07 09:55:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-224f3e8a-ecdf-4b4d-bf25-a3533ca2068e tempest-VolumesActionsTest-955477661 None] Lock "cinder-e0485bdb-c6df-455e-b93d-6a6e13f874d8-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:55:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:55:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=15,cinder:SELECT=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:55:57 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (4a533a50-512e-4f4e-b381-53466d4c316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d73e8c-fa9c-4093-8ba1-d2e4f568e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d73e8c-fa9c-4093-8ba1-d2e4f568e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1705408859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b58e9d9-e662-44da-a397-275ed40642d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:55:58Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e83140-4372-4cd8-8b3b-a4a078e57558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e83140-4372-4cd8-8b3b-a4a078e57558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be876aa2-7967-4e54-9658-e382d60c4213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be876aa2-7967-4e54-9658-e382d60c4213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b58e9d9-e662-44da-a397-275ed40642d7', 'volume_name': 'volume-7b58e9d9-e662-44da-a397-275ed40642d7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b332298-8b25-4d7a-a022-55cc23304a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b332298-8b25-4d7a-a022-55cc23304a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62d1c8-258c-49a9-843c-141d34f3f516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:58 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Volume 7b58e9d9-e662-44da-a397-275ed40642d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b58e9d9-e662-44da-a397-275ed40642d7', 'volume_size': 1} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1705408859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b58e9d9-e662-44da-a397-275ed40642d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:55:58Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Creating volume 7b58e9d9-e662-44da-a397-275ed40642d7 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:55:58 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:58 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 1073741824 Sep 07 09:55:58 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:58 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 1073741824" returned: 0 in 0.584s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:58 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 Sep 07 09:55:58 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:59 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7" returned: 0 in 0.359s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:55:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:55:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62d1c8-258c-49a9-843c-141d34f3f516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b58e9d9-e662-44da-a397-275ed40642d7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad808fb-86d1-4355-8285-c24c8b4adf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:55:59 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Volume volume-7b58e9d9-e662-44da-a397-275ed40642d7 (7b58e9d9-e662-44da-a397-275ed40642d7): created successfully Sep 07 09:55:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad808fb-86d1-4355-8285-c24c8b4adf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:55:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (4a533a50-512e-4f4e-b381-53466d4c316d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:55:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e934b754-9b98-4e4d-8f59-3c452da4c033 tempest-VolumesActionsTest-955477661 None] Created volume successfully. Sep 07 09:56:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-7b58e9d9-e662-44da-a397-275ed40642d7-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Lock "cinder-7b58e9d9-e662-44da-a397-275ed40642d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-quobyte-7b58e9d9-e662-44da-a397-275ed40642d7" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-7b58e9d9-e662-44da-a397-275ed40642d7" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:00 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de9ab3-0976-4d72-847e-1a8828e19cb1]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:00 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 Sep 07 09:56:00 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:01 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7" returned: 0 in 0.617s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:01 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7 Sep 07 09:56:01 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:01 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7b58e9d9-e662-44da-a397-275ed40642d7" returned: 0 in 0.437s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-7b58e9d9-e662-44da-a397-275ed40642d7" released by "delete_volume" :: held 1.131s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Created reservations ['dc531d8c-9c1a-4327-95d9-9a05cbda9959', '557ec2cf-637e-40cf-ba83-1c42c7a3ffeb', '80688344-8402-4a2a-945d-be87f3139425', '038b3d92-b714-45d4-9962-fce2e4ca75e5'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:01 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:56:01 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:02 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.489s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:02 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Deleted volume successfully. Sep 07 09:56:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ebb3f7a9-6f6f-4e0b-86db-d53e9e1fb276 tempest-VolumesActionsTest-249339574 None] Lock "cinder-7b58e9d9-e662-44da-a397-275ed40642d7-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (6e932ee5-41c1-42c7-8853-da152d5454c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003159bb-d4f0-4273-9de9-bd16abcc65c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003159bb-d4f0-4273-9de9-bd16abcc65c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105269818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f659282-57aa-4672-96c0-3a26006befec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:04Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e91bc5-367c-45fc-bbca-0b51e1547405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e91bc5-367c-45fc-bbca-0b51e1547405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41f7c5f-ebc4-427f-84ee-78e3090901a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41f7c5f-ebc4-427f-84ee-78e3090901a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f659282-57aa-4672-96c0-3a26006befec', 'volume_name': 'volume-7f659282-57aa-4672-96c0-3a26006befec', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2731add9-8752-4819-9e3e-f77d2cba5aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2731add9-8752-4819-9e3e-f77d2cba5aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af299006-cd12-4b6d-bbe8-972fc168698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Volume 7f659282-57aa-4672-96c0-3a26006befec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f659282-57aa-4672-96c0-3a26006befec', 'volume_size': 1} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105269818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f659282-57aa-4672-96c0-3a26006befec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:04Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Creating volume 7f659282-57aa-4672-96c0-3a26006befec {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:56:03 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:56:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:03 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec 1073741824 Sep 07 09:56:03 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:04 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec 1073741824" returned: 0 in 0.901s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:04 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec Sep 07 09:56:04 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:05 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec" returned: 0 in 0.367s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af299006-cd12-4b6d-bbe8-972fc168698d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f659282-57aa-4672-96c0-3a26006befec', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364c9845-5245-421c-bc20-87659ae5f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:05 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Volume volume-7f659282-57aa-4672-96c0-3a26006befec (7f659282-57aa-4672-96c0-3a26006befec): created successfully Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364c9845-5245-421c-bc20-87659ae5f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (6e932ee5-41c1-42c7-8853-da152d5454c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-68ea50d7-d894-4add-8ba5-08098d5c6cd6 tempest-VolumesActionsTest-955477661 None] Created volume successfully. Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cd7a50d5-9b95-4259-ab27-6190892777ef tempest-VolumesActionsTest-1603755633 None] Acquiring lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5" by "attach_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cd7a50d5-9b95-4259-ab27-6190892777ef tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5" acquired by "attach_volume" :: waited 0.055s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cd7a50d5-9b95-4259-ab27-6190892777ef tempest-VolumesActionsTest-1603755633 None] Attaching volume 66f9eece-0e2a-4408-821f-dcb95b1c4af5 to instance f6a983ac-7d92-403f-a342-324b9d94927e at mountpoint /dev/vdb on host None. Sep 07 09:56:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-7f659282-57aa-4672-96c0-3a26006befec-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Lock "cinder-7f659282-57aa-4672-96c0-3a26006befec-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cd7a50d5-9b95-4259-ab27-6190892777ef tempest-VolumesActionsTest-1603755633 None] Attach volume completed successfully. Sep 07 09:56:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cd7a50d5-9b95-4259-ab27-6190892777ef tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5" released by "attach_volume" :: held 0.410s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-quobyte-7f659282-57aa-4672-96c0-3a26006befec" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-7f659282-57aa-4672-96c0-3a26006befec" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:06 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[257a0e64-b957-4505-86ee-efa9ef206723]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:06 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec Sep 07 09:56:06 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:07 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec" returned: 0 in 1.179s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:07 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec Sep 07 09:56:07 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-283a1019-8243-490e-8c5f-dcd70b235758 tempest-VolumesActionsTest-1603755633 None] Acquiring lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-detach_volume" by "detach_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-283a1019-8243-490e-8c5f-dcd70b235758 tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:07 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-283a1019-8243-490e-8c5f-dcd70b235758 tempest-VolumesActionsTest-1603755633 None] Detaching volume 66f9eece-0e2a-4408-821f-dcb95b1c4af5 from instance f6a983ac-7d92-403f-a342-324b9d94927e. Sep 07 09:56:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-283a1019-8243-490e-8c5f-dcd70b235758 tempest-VolumesActionsTest-1603755633 None] Detach volume completed successfully. Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-283a1019-8243-490e-8c5f-dcd70b235758 tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-detach_volume" released by "detach_volume" :: held 0.204s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:08 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f659282-57aa-4672-96c0-3a26006befec" returned: 0 in 0.629s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-7f659282-57aa-4672-96c0-3a26006befec" released by "delete_volume" :: held 1.949s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Created reservations ['38feaad0-da96-47ff-b431-5b7732cc479c', '03912706-91d2-4772-9f48-af89ab0d6ca4', '7a2068b5-1496-4f90-a3c0-6c4ec4445462', 'a3a55bce-07d5-4bf8-9923-334721a2adfe'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:08 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:56:08 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:09 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.345s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:09 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Deleted volume successfully. Sep 07 09:56:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fc304c8-c683-4555-b7b7-10c9883f0943 tempest-VolumesActionsTest-249339574 None] Lock "cinder-7f659282-57aa-4672-96c0-3a26006befec-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (785a75b3-8cdb-42a2-be0d-c71b649fafef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5ce104-6cdd-4893-8c7f-c1b1dc0cce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5ce104-6cdd-4893-8c7f-c1b1dc0cce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1598698166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d549a9-15f0-4a32-8b81-07f8c60baed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:11Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6928826c-ef69-4810-83a9-597b9c2ddd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6928826c-ef69-4810-83a9-597b9c2ddd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37152c0e-f251-4d23-9263-ae36002474c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37152c0e-f251-4d23-9263-ae36002474c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d549a9-15f0-4a32-8b81-07f8c60baed8', 'volume_name': 'volume-02d549a9-15f0-4a32-8b81-07f8c60baed8', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa04abcf-3165-4b9b-95da-3a9e046391e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa04abcf-3165-4b9b-95da-3a9e046391e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e8115c-35b8-4069-bb11-cf631d4271cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Volume 02d549a9-15f0-4a32-8b81-07f8c60baed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d549a9-15f0-4a32-8b81-07f8c60baed8', 'volume_size': 1} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1598698166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d549a9-15f0-4a32-8b81-07f8c60baed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:11Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Creating volume 02d549a9-15f0-4a32-8b81-07f8c60baed8 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:56:11 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:56:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:11 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 1073741824 Sep 07 09:56:11 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:12 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 1073741824" returned: 0 in 0.811s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:12 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 Sep 07 09:56:12 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:12 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8" returned: 0 in 0.404s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e8115c-35b8-4069-bb11-cf631d4271cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d549a9-15f0-4a32-8b81-07f8c60baed8', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540152cb-b36b-4ea2-bba1-87edaec49c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Volume volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 (02d549a9-15f0-4a32-8b81-07f8c60baed8): created successfully Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540152cb-b36b-4ea2-bba1-87edaec49c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (785a75b3-8cdb-42a2-be0d-c71b649fafef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-dedeca6f-f980-4ee7-98a0-965f63d55ae2 tempest-VolumesActionsTest-955477661 None] Created volume successfully. Sep 07 09:56:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-02d549a9-15f0-4a32-8b81-07f8c60baed8-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Lock "cinder-02d549a9-15f0-4a32-8b81-07f8c60baed8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-quobyte-02d549a9-15f0-4a32-8b81-07f8c60baed8" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-02d549a9-15f0-4a32-8b81-07f8c60baed8" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc240c8-1f85-48ae-a531-4e9336a2669a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:14 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 Sep 07 09:56:14 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:14 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8" returned: 0 in 0.779s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:14 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8 Sep 07 09:56:14 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:15 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-02d549a9-15f0-4a32-8b81-07f8c60baed8" returned: 0 in 0.649s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-02d549a9-15f0-4a32-8b81-07f8c60baed8" released by "delete_volume" :: held 1.539s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Created reservations ['db9dfd08-edcb-4dae-be5f-b640f9faac85', 'a6f0270b-08d6-4972-95c1-046e5d3db4e7', '88d834f9-0f5f-4e85-a994-876d62aa2b6c', '85ab8195-ffb3-46c1-8494-058abde1b976'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:15 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:56:15 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:16 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.638s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:16 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Deleted volume successfully. Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-692486a4-56f1-401a-a9c5-72f373f50f14 tempest-VolumesActionsTest-249339574 None] Lock "cinder-02d549a9-15f0-4a32-8b81-07f8c60baed8-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Flow 'volume_create_manager' (2952810d-756f-4b90-8a44-999a82cc0c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6811862-ecf2-44e1-a52f-974c118a8a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6811862-ecf2-44e1-a52f-974c118a8a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1982213410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460c1cb1-c348-4fa8-bb6d-97de865dc23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fb561c766247ee949c5772077b5e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:16Z,use_quota=True,user_id='b0142b0c500f4714be6749c436147e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f72096-9f4c-44ed-a88e-ceff07c1eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f72096-9f4c-44ed-a88e-ceff07c1eede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc781d75-5b48-4a56-89e8-5295ac0429c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc781d75-5b48-4a56-89e8-5295ac0429c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '460c1cb1-c348-4fa8-bb6d-97de865dc23d', 'volume_name': 'volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7e80b0-3feb-4f64-8893-65d9ae20cd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7e80b0-3feb-4f64-8893-65d9ae20cd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642d712e-7a3d-4166-8b48-ee25c064d96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Volume 460c1cb1-c348-4fa8-bb6d-97de865dc23d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d', 'volume_size': 1} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1982213410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460c1cb1-c348-4fa8-bb6d-97de865dc23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fb561c766247ee949c5772077b5e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:16Z,use_quota=True,user_id='b0142b0c500f4714be6749c436147e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Creating volume 460c1cb1-c348-4fa8-bb6d-97de865dc23d {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:56:16 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:56:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:16 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d 1073741824 Sep 07 09:56:16 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:17 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:56:17 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (78d037e2-679d-465f-9ace-1783cccd96f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de7da1a-912a-4c0e-8417-03448e7a5d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d 1073741824" returned: 0 in 1.146s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de7da1a-912a-4c0e-8417-03448e7a5d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1093632365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f31028d-72d7-47ae-a0c6-f392bc7c4bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:18Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76808f2-09d6-45e2-b5f9-8228e793ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76808f2-09d6-45e2-b5f9-8228e793ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d23dbf-3af2-49b3-8f36-559f0df4770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d23dbf-3af2-49b3-8f36-559f0df4770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f31028d-72d7-47ae-a0c6-f392bc7c4bc0', 'volume_name': 'volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a729ef-c8ff-4c32-9279-a3b35e5dd316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a729ef-c8ff-4c32-9279-a3b35e5dd316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d969afe0-49f8-455f-98f9-2ee70eacf224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:18 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Volume 3f31028d-72d7-47ae-a0c6-f392bc7c4bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0', 'volume_size': 1} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:18 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d Sep 07 09:56:18 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:18 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d" returned: 0 in 0.516s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.079s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642d712e-7a3d-4166-8b48-ee25c064d96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491f0324-9e8f-435d-8c82-5bb3b2f2adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[461dec94-0d6e-402e-8b83-f8b37ada09b2]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:18 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Volume volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d (460c1cb1-c348-4fa8-bb6d-97de865dc23d): created successfully Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491f0324-9e8f-435d-8c82-5bb3b2f2adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Flow 'volume_create_manager' (2952810d-756f-4b90-8a44-999a82cc0c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f215cec5-1c7f-432a-b53d-85dd0f2cb364 tempest-TestMinimumBasicScenario-776331143 None] Created volume successfully. Sep 07 09:56:19 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:19 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:19 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.812s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:19 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82bad38-d16e-46af-865c-f1dd3fd5503a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:19 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:19 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:20 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.656s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.cca2bd53-24cf-4b93-ab21-839702693b1dpo8aekbb.img {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:20 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.cca2bd53-24cf-4b93-ab21-839702693b1dpo8aekbb.img Sep 07 09:56:20 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Flow 'volume_create_manager' (88c09e30-bcb9-4cb7-9439-d57a920e2f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64deeb1-ced6-4a0a-bd88-212ddb717f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64deeb1-ced6-4a0a-bd88-212ddb717f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1094616951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24051b76-9f35-497c-bfe1-b2a7c9602e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735c26ea35da462e88953ecc76b717c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:21Z,use_quota=True,user_id='d3b7be9486984a6e979daf0236f7079f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1c560c-6335-4a85-99f2-91f11409702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1c560c-6335-4a85-99f2-91f11409702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db92f512-d234-406e-8aa8-d8da016ba9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db92f512-d234-406e-8aa8-d8da016ba9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24051b76-9f35-497c-bfe1-b2a7c9602e8e', 'volume_name': 'volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7921f3e-2bba-4d0d-9dbe-7dba1a269fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7921f3e-2bba-4d0d-9dbe-7dba1a269fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32764ad4-d2ec-48f7-900f-88fa919174c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Volume 24051b76-9f35-497c-bfe1-b2a7c9602e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e', 'volume_size': 1} Sep 07 09:56:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-f321ef26-9085-4815-80d3-fe34b87ced42 req-adc5ee64-6571-44db-97fd-30380b38fbc9 tempest-TestMinimumBasicScenario-776331143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:25 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.cca2bd53-24cf-4b93-ab21-839702693b1dpo8aekbb.img" returned: 0 in 5.196s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd062a0b-835d-48bb-95d5-0fb70e49b7af]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:25 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:25 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:25 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.511s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:25 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.cca2bd53-24cf-4b93-ab21-839702693b1dpo8aekbb.img {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:56:25 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Converted 1024.00 MB image at 196.98 MB/s Sep 07 09:56:25 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] cca2bd53-24cf-4b93-ab21-839702693b1d was raw, no need to convert to raw {{(pid=87290) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 09:56:32 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=36,cinder:INSERT=11,cinder:UPDATE=36,cinder:DELETE=5 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:56:35 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=44,cinder:SELECT=32,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:41 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:56:41 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:41 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.257s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:56:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.123s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Uploaded volume to glance image-id: cca2bd53-24cf-4b93-ab21-839702693b1d. {{(pid=87290) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.706s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1093632365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f31028d-72d7-47ae-a0c6-f392bc7c4bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:18Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Creating volume 3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:56:44 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:56:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:44 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 1073741824 Sep 07 09:56:44 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-04202abf-efbf-43e4-a86e-5b1905f5e083 tempest-VolumesActionsTest-1603755633 None] Copy volume to image completed successfully. Sep 07 09:56:45 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 1073741824" returned: 0 in 0.432s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:45 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 Sep 07 09:56:45 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:45 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0" returned: 0 in 0.255s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.326s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1094616951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24051b76-9f35-497c-bfe1-b2a7c9602e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735c26ea35da462e88953ecc76b717c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:21Z,use_quota=True,user_id='d3b7be9486984a6e979daf0236f7079f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Creating volume 24051b76-9f35-497c-bfe1-b2a7c9602e8e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:56:45 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:45 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e 1073741824 Sep 07 09:56:45 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d969afe0-49f8-455f-98f9-2ee70eacf224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cf18dd-d274-45b1-add8-478e5a530efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:45 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Volume volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 (3f31028d-72d7-47ae-a0c6-f392bc7c4bc0): created successfully Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cf18dd-d274-45b1-add8-478e5a530efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (78d037e2-679d-465f-9ace-1783cccd96f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-acef6325-e58f-4373-9744-9dd00e853ab6 tempest-VolumesActionsTest-955477661 None] Created volume successfully. Sep 07 09:56:46 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e 1073741824" returned: 0 in 0.463s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:46 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e Sep 07 09:56:46 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:46 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e" returned: 0 in 0.262s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-f321ef26-9085-4815-80d3-fe34b87ced42 req-adc5ee64-6571-44db-97fd-30380b38fbc9 tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.029s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32764ad4-d2ec-48f7-900f-88fa919174c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ac40a7-c62d-4c61-bd67-0e32db4a8011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-f321ef26-9085-4815-80d3-fe34b87ced42 req-adc5ee64-6571-44db-97fd-30380b38fbc9 tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:46 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Volume volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e (24051b76-9f35-497c-bfe1-b2a7c9602e8e): created successfully Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ac40a7-c62d-4c61-bd67-0e32db4a8011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Flow 'volume_create_manager' (88c09e30-bcb9-4cb7-9439-d57a920e2f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f1e8c707-8a10-4204-abdc-d0a4ddc8c19e tempest-TestImageHashVerification-6793459 None] Created volume successfully. Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-f321ef26-9085-4815-80d3-fe34b87ced42 req-adc5ee64-6571-44db-97fd-30380b38fbc9 tempest-TestMinimumBasicScenario-776331143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d092d7b-0ce7-4b7a-a8cc-f93e36882775', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:56:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-f321ef26-9085-4815-80d3-fe34b87ced42 req-adc5ee64-6571-44db-97fd-30380b38fbc9 tempest-TestMinimumBasicScenario-776331143 None] attachment_update completed successfully. Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[609fe13a-5c3f-4c99-8b72-273b6fc6aecc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:46 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:46 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Lock "cinder-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Acquiring lock "cinder-quobyte-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[80201d9c-9ab5-44cd-a139-337fd1e65fb1]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:47 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.526s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e39d6a-2078-4d37-8c13-b96261210884]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:47 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 Sep 07 09:56:47 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:47 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:47 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:47 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0" returned: 0 in 0.519s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:47 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0 Sep 07 09:56:47 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:47 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.420s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:47 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img Sep 07 09:56:47 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:47 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Lock "cinder-quobyte-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0" released by "delete_volume" :: held 0.882s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:47 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Created reservations ['e09f9465-d282-42da-ba04-02dab775f6d8', '95ec1b2a-de6d-40ed-9fb5-6d9c59089d16', '76afdfb1-acc2-4ec6-84d2-825493a00019', 'ec637a66-515c-42ba-81fc-369357f0094d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:56:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:48 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:56:48 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:49 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 1.054s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:49 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Deleted volume successfully. Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (062bab37-306d-440e-9658-ce28359efb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f591512-c2e8-422f-a258-6ba723c102ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a09f4c7-6ede-4496-8437-9263b2700269 tempest-VolumesActionsTest-249339574 None] Lock "cinder-3f31028d-72d7-47ae-a0c6-f392bc7c4bc0-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f591512-c2e8-422f-a258-6ba723c102ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1653032445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed406c24-363b-40ab-9201-5c83d53e1592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:49Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e607d0-d1f0-4088-9c3d-40896df609f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e607d0-d1f0-4088-9c3d-40896df609f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c62058-f696-4c25-828b-84da5d0023d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c62058-f696-4c25-828b-84da5d0023d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed406c24-363b-40ab-9201-5c83d53e1592', 'volume_name': 'volume-ed406c24-363b-40ab-9201-5c83d53e1592', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f1452c-2d8b-4e5b-b9d8-becef46ed67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f1452c-2d8b-4e5b-b9d8-becef46ed67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b9f648-027e-4236-b4ca-bc4ea8887435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:56:49 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Volume ed406c24-363b-40ab-9201-5c83d53e1592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed406c24-363b-40ab-9201-5c83d53e1592', 'volume_size': 1} Sep 07 09:56:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:52 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img" returned: 0 in 4.793s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:52 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce52bcad-b9b1-41b8-aa4c-75ba98eaa7a5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:52 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:52 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:53 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.593s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:56:53 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Converted 1024.00 MB image at 213.59 MB/s Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] 2813e56b-7cdd-4214-ab11-c07a86cdf49f was raw, converting to qcow2 {{(pid=87290) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c073c66-7660-4c21-970e-ab95236b6b8b]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:53 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img Sep 07 09:56:53 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:53 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img" returned: 0 in 0.436s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:53 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img Sep 07 09:56:53 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:53 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img" returned: 1 in 0.399s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:56:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img /opt/stack/data/cinder/conversion/vol_upload_o1alqf_j {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:53 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img /opt/stack/data/cinder/conversion/vol_upload_o1alqf_j Sep 07 09:56:53 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:54 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img /opt/stack/data/cinder/conversion/vol_upload_o1alqf_j" returned: 0 in 0.357s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:54 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Image conversion details: src /opt/stack/data/cinder/conversion/66f9eece-0e2a-4408-821f-dcb95b1c4af5.temp_image.2813e56b-7cdd-4214-ab11-c07a86cdf49ffrwpbt0c.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_o1alqf_j {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:56:54 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 09:56:54 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9009b1-ab91-4a2b-90db-a183ce5dd8fc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o1alqf_j {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:54 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o1alqf_j Sep 07 09:56:54 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:54 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o1alqf_j" returned: 0 in 0.408s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.481s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Uploaded volume to glance image-id: 2813e56b-7cdd-4214-ab11-c07a86cdf49f. {{(pid=87290) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.268s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa33078-bb70-424f-8879-e4eb0fae64e9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-16f71703-f45d-415c-98e2-ee06176ced0f tempest-VolumesActionsTest-1603755633 None] Copy volume to image completed successfully. Sep 07 09:56:56 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e Sep 07 09:56:56 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:56 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e" returned: 0 in 0.438s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20c7aa5-d47e-4be4-80d2-38ba03a50aed]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:56 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e Sep 07 09:56:56 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Acquiring lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Acquiring lock "cinder-quobyte-66f9eece-0e2a-4408-821f-dcb95b1c4af5" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:56:57 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e" returned: 0 in 0.508s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e /opt/stack/data/cinder/conversion/24051b76-9f35-497c-bfe1-b2a7c9602e8e.temp_image.54f37f17-5e12-405b-ba6a-3327b7fa7481pp9t6u9k.img {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Lock "cinder-quobyte-66f9eece-0e2a-4408-821f-dcb95b1c4af5" acquired by "delete_volume" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:56:57 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e /opt/stack/data/cinder/conversion/24051b76-9f35-497c-bfe1-b2a7c9602e8e.temp_image.54f37f17-5e12-405b-ba6a-3327b7fa7481pp9t6u9k.img Sep 07 09:56:57 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8309ae9c-16a7-4c77-8641-c091bf7f937f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:57 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:57 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:57 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.590s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:57 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5 Sep 07 09:56:57 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:58 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-66f9eece-0e2a-4408-821f-dcb95b1c4af5" returned: 0 in 0.634s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Lock "cinder-quobyte-66f9eece-0e2a-4408-821f-dcb95b1c4af5" released by "delete_volume" :: held 1.282s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Created reservations ['c8ff9035-46b9-422c-9be1-599dae12c770', 'b408b0be-5687-4a83-82d1-4028792b008b', '5e83a4cc-a8ad-4bdb-953c-56456f51fc77', 'a4e02d02-848e-483f-99fe-53d8ab3ee9ae'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:58 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:56:58 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:59 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.608s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:59 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Deleted volume successfully. Sep 07 09:56:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81824b2f-f250-4994-ae13-ededca49e745 tempest-VolumesActionsTest-1603755633 None] Lock "cinder-66f9eece-0e2a-4408-821f-dcb95b1c4af5-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:02 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e /opt/stack/data/cinder/conversion/24051b76-9f35-497c-bfe1-b2a7c9602e8e.temp_image.54f37f17-5e12-405b-ba6a-3327b7fa7481pp9t6u9k.img" returned: 0 in 5.470s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5003262-55e8-4e2e-a978-8589174b4421]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:02 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e Sep 07 09:57:02 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:03 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e" returned: 0 in 0.610s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:03 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/conversion/24051b76-9f35-497c-bfe1-b2a7c9602e8e.temp_image.54f37f17-5e12-405b-ba6a-3327b7fa7481pp9t6u9k.img {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:57:03 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Converted 1024.00 MB image at 187.15 MB/s Sep 07 09:57:03 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] 54f37f17-5e12-405b-ba6a-3327b7fa7481 was raw, no need to convert to raw {{(pid=87290) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Flow 'volume_create_manager' (3e3c14ed-64df-486c-adc2-6a90aad72179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b550de2-647f-45a1-8651-1f8a7bf0bb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b550de2-647f-45a1-8651-1f8a7bf0bb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-324394306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d42e946-2912-44fd-94f1-6e29d80e38f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2400167927848d881ff22425886cfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:11Z,use_quota=True,user_id='465ba0a6580341f7ba2e16717c342529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b98f41-6f1f-435e-9843-821e8659fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b98f41-6f1f-435e-9843-821e8659fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9385908-e83c-4755-8326-e223d410725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9385908-e83c-4755-8326-e223d410725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d42e946-2912-44fd-94f1-6e29d80e38f4', 'volume_name': 'volume-4d42e946-2912-44fd-94f1-6e29d80e38f4', 'volume_size': 2}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43982927-c0d9-42af-8b51-de9f6dbbbe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43982927-c0d9-42af-8b51-de9f6dbbbe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128576d9-91e6-4b67-bf86-2894970abca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Volume 4d42e946-2912-44fd-94f1-6e29d80e38f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d42e946-2912-44fd-94f1-6e29d80e38f4', 'volume_size': 2} Sep 07 09:57:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:20 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=24,cinder:DELETE=2,cinder:SELECT=19,cinder:INSERT=5 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:57:20 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=29,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.560s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Uploaded volume to glance image-id: 54f37f17-5e12-405b-ba6a-3327b7fa7481. {{(pid=87290) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.073s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1653032445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed406c24-363b-40ab-9201-5c83d53e1592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceaeb43f64424569bad8bb851d27f461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:56:49Z,use_quota=True,user_id='6ae6eb22b521423a999f0b3b1701b6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Creating volume ed406c24-363b-40ab-9201-5c83d53e1592 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:24 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:24 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 1073741824 Sep 07 09:57:24 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:24 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0b768220-1257-4bf6-a825-626b690bf691 tempest-TestImageHashVerification-6793459 None] Copy volume to image completed successfully. Sep 07 09:57:25 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 1073741824" returned: 0 in 0.517s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:25 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 Sep 07 09:57:25 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:25 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592" returned: 0 in 0.291s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.716s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-324394306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d42e946-2912-44fd-94f1-6e29d80e38f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2400167927848d881ff22425886cfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:11Z,use_quota=True,user_id='465ba0a6580341f7ba2e16717c342529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Creating volume 4d42e946-2912-44fd-94f1-6e29d80e38f4 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:25 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 2147483648 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:25 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 2147483648 Sep 07 09:57:25 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b9f648-027e-4236-b4ca-bc4ea8887435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed406c24-363b-40ab-9201-5c83d53e1592', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae0ee1-a80f-4fcd-bf44-67fa2a64c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:25 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Volume volume-ed406c24-363b-40ab-9201-5c83d53e1592 (ed406c24-363b-40ab-9201-5c83d53e1592): created successfully Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae0ee1-a80f-4fcd-bf44-67fa2a64c215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Flow 'volume_create_manager' (062bab37-306d-440e-9658-ce28359efb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bf310da4-b135-4f5e-918c-bbb6833703d4 tempest-VolumesActionsTest-955477661 None] Created volume successfully. Sep 07 09:57:26 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 2147483648" returned: 0 in 0.589s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:26 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 Sep 07 09:57:26 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Acquiring lock "cinder-24051b76-9f35-497c-bfe1-b2a7c9602e8e-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Lock "cinder-24051b76-9f35-497c-bfe1-b2a7c9602e8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Acquiring lock "cinder-quobyte-24051b76-9f35-497c-bfe1-b2a7c9602e8e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Lock "cinder-quobyte-24051b76-9f35-497c-bfe1-b2a7c9602e8e" acquired by "delete_volume" :: waited 0.030s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:26 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39e7a59-aed6-44ee-8531-56d4b340cb8d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4" returned: 0 in 0.343s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128576d9-91e6-4b67-bf86-2894970abca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d42e946-2912-44fd-94f1-6e29d80e38f4', 'volume_size': 2}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf55f58-1096-44ea-83d6-bdf3a49cef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:26 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Volume volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 (4d42e946-2912-44fd-94f1-6e29d80e38f4): created successfully Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf55f58-1096-44ea-83d6-bdf3a49cef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Flow 'volume_create_manager' (3e3c14ed-64df-486c-adc2-6a90aad72179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8005fa14-c93b-46e0-869b-b9b1337b1e11 tempest-VolumesCloneNegativeTest-2142471065 None] Created volume successfully. Sep 07 09:57:26 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e Sep 07 09:57:26 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:27 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Acquiring lock "cinder-4d42e946-2912-44fd-94f1-6e29d80e38f4-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e" returned: 0 in 0.551s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:27 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e Sep 07 09:57:27 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "cinder-4d42e946-2912-44fd-94f1-6e29d80e38f4-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Acquiring lock "cinder-quobyte-4d42e946-2912-44fd-94f1-6e29d80e38f4" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "cinder-quobyte-4d42e946-2912-44fd-94f1-6e29d80e38f4" acquired by "delete_volume" :: waited 0.033s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[08183257-cdea-4e6b-8c54-471989de7e3e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Acquiring lock "cinder-ed406c24-363b-40ab-9201-5c83d53e1592-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:27 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 Sep 07 09:57:27 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Lock "cinder-ed406c24-363b-40ab-9201-5c83d53e1592-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Acquiring lock "cinder-quobyte-ed406c24-363b-40ab-9201-5c83d53e1592" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:27 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Lock "cinder-quobyte-ed406c24-363b-40ab-9201-5c83d53e1592" acquired by "delete_volume" :: waited 0.033s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-24051b76-9f35-497c-bfe1-b2a7c9602e8e" returned: 0 in 0.561s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f82009-2f6c-4d2f-bcaf-06bdf5fe4517]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Lock "cinder-quobyte-24051b76-9f35-497c-bfe1-b2a7c9602e8e" released by "delete_volume" :: held 1.186s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Created reservations ['6e2a8f93-787c-4029-9974-03103ad9c22f', '4f8461b6-babe-469a-a7f6-0d44c29dedf7', '5772a778-c724-445c-bc03-86cf58e36137', 'a3fac3b9-9648-4d5f-a976-b9a17376695f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:27 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 Sep 07 09:57:27 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:27 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4" returned: 0 in 0.623s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:27 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:27 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:27 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4 Sep 07 09:57:27 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:28 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592" returned: 0 in 0.510s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:28 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.342s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:28 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592 Sep 07 09:57:28 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Deleted volume successfully. Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-53a06706-4433-4bb9-bbdf-5e269af8ef9f tempest-TestImageHashVerification-6793459 None] Lock "cinder-24051b76-9f35-497c-bfe1-b2a7c9602e8e-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:28 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4d42e946-2912-44fd-94f1-6e29d80e38f4" returned: 0 in 0.381s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "cinder-quobyte-4d42e946-2912-44fd-94f1-6e29d80e38f4" released by "delete_volume" :: held 1.066s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Created reservations ['b2ad3f55-d0d7-4142-b7f9-43d5e5a67306', 'd9eb9e2f-3b6f-4f38-8be6-ab1ab7175083', 'e27398e9-0e00-4c78-b3e4-24c8907e4121', 'ce3618aa-bab1-484e-9d70-e186b6ebbb2b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:28 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:28 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:28 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ed406c24-363b-40ab-9201-5c83d53e1592" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Lock "cinder-quobyte-ed406c24-363b-40ab-9201-5c83d53e1592" released by "delete_volume" :: held 0.908s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Created reservations ['7cd19695-a7f0-4786-b2c4-97f1a48cadda', 'e76eb6f7-7779-45f5-9fc0-ffd42cb2975b', '40e41c17-dfe2-4359-bc27-1ffa6c25be86', '6e4f33f6-7326-4138-8d0c-53b95da14b68'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:28 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:28 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:28 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Deleted volume successfully. Sep 07 09:57:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ae52cd27-b920-47e3-afb6-c9bc49718d02 tempest-VolumesCloneNegativeTest-2142471065 None] Lock "cinder-4d42e946-2912-44fd-94f1-6e29d80e38f4-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:29 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.355s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Deleted volume successfully. Sep 07 09:57:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c0b11621-69cf-4e6b-970d-7cd429f18936 tempest-VolumesActionsTest-955477661 None] Lock "cinder-ed406c24-363b-40ab-9201-5c83d53e1592-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-55b0dd9a-3200-40b1-bb51-6955c6bb72c8 req-8586cc23-99a6-45f4-9d80-151e0eaf269e tempest-TestMinimumBasicScenario-776331143 None] Terminate volume connection completed successfully. Sep 07 09:57:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-55b0dd9a-3200-40b1-bb51-6955c6bb72c8 req-8586cc23-99a6-45f4-9d80-151e0eaf269e tempest-TestMinimumBasicScenario-776331143 None] Deleting attachment 4d092d7b-0ce7-4b7a-a8cc-f93e36882775. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:57:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Acquiring lock "cinder-460c1cb1-c348-4fa8-bb6d-97de865dc23d-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Lock "cinder-460c1cb1-c348-4fa8-bb6d-97de865dc23d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Acquiring lock "cinder-quobyte-460c1cb1-c348-4fa8-bb6d-97de865dc23d" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Lock "cinder-quobyte-460c1cb1-c348-4fa8-bb6d-97de865dc23d" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb9b0d4-bd13-49b1-88b5-ac768fde57f8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:30 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d Sep 07 09:57:30 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:31 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d" returned: 0 in 0.450s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:31 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d Sep 07 09:57:31 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:31 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-460c1cb1-c348-4fa8-bb6d-97de865dc23d" returned: 0 in 0.295s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Lock "cinder-quobyte-460c1cb1-c348-4fa8-bb6d-97de865dc23d" released by "delete_volume" :: held 0.793s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Created reservations ['b0e38293-5810-44a9-ae3f-e23148a808f8', '77e7a4f8-8334-4681-a1cc-ba11326c7f11', '327c341c-ba98-4487-bc4d-c101480e13f3', 'fb2ee825-7893-46e1-8eb2-316fbfa9cc0d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:31 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:31 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:31 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.352s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:31 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Deleted volume successfully. Sep 07 09:57:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fe03c59e-0748-404b-a45c-2ee98f06380f tempest-TestMinimumBasicScenario-776331143 None] Lock "cinder-460c1cb1-c348-4fa8-bb6d-97de865dc23d-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (454552c0-ca17-4e79-b353-5335e97e0484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df26903-addc-47e7-8881-0a9269f26787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df26903-addc-47e7-8881-0a9269f26787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-26748234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc5aae3-1312-47ee-9ca2-828fd1981d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:34Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e485342c-2a8e-47c6-8d74-d45ba4f0076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e485342c-2a8e-47c6-8d74-d45ba4f0076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4250f4-68b0-4c51-902a-4684f97d801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4250f4-68b0-4c51-902a-4684f97d801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc5aae3-1312-47ee-9ca2-828fd1981d88', 'volume_name': 'volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76c9fdd-f0c6-4366-945b-6aa220cfa5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76c9fdd-f0c6-4366-945b-6aa220cfa5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b1edf5-276e-41c1-8b8a-dbb2618a72a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:34 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Volume 5fc5aae3-1312-47ee-9ca2-828fd1981d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88', 'volume_size': 1} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-26748234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc5aae3-1312-47ee-9ca2-828fd1981d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:34Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Creating volume 5fc5aae3-1312-47ee-9ca2-828fd1981d88 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:34 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:34 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 1073741824 Sep 07 09:57:34 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:34 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (0527b514-2a76-4ba6-8a3d-7333531e40ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7835d9e-7a89-4f55-8939-3005a2e73048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7835d9e-7a89-4f55-8939-3005a2e73048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139032246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3beb587c-7e61-475b-b8b0-bb76e29cc105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:35Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c21476-771c-4bcf-91c8-3297e96a5304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c21476-771c-4bcf-91c8-3297e96a5304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ed75a5-23cb-44de-9563-515e4e5f8f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ed75a5-23cb-44de-9563-515e4e5f8f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3beb587c-7e61-475b-b8b0-bb76e29cc105', 'volume_name': 'volume-3beb587c-7e61-475b-b8b0-bb76e29cc105', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa8ca19-5ee6-4f8d-a858-14cdfe03b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa8ca19-5ee6-4f8d-a858-14cdfe03b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6335d940-c9f1-466b-8325-b7ab79c2d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Volume 3beb587c-7e61-475b-b8b0-bb76e29cc105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3beb587c-7e61-475b-b8b0-bb76e29cc105', 'volume_size': 1} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:35 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 1073741824" returned: 0 in 0.758s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:35 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 Sep 07 09:57:35 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (df4033df-f955-4701-b9bd-42251bedf316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7a9b41-fc77-45f7-a691-f19ac4bdf5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7a9b41-fc77-45f7-a691-f19ac4bdf5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1362809831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d0e3a3-2940-49f6-a060-2bf449352571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:35Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58421373-e147-465d-92e9-37aac70f915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58421373-e147-465d-92e9-37aac70f915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28ac002-ba0e-45de-aaea-29d5ffce40fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28ac002-ba0e-45de-aaea-29d5ffce40fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d0e3a3-2940-49f6-a060-2bf449352571', 'volume_name': 'volume-a5d0e3a3-2940-49f6-a060-2bf449352571', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d82e5-fe67-458b-ac16-ac50fbbdcda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d82e5-fe67-458b-ac16-ac50fbbdcda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703dc2a0-c649-412b-b9aa-85d38ea74e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Volume a5d0e3a3-2940-49f6-a060-2bf449352571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d0e3a3-2940-49f6-a060-2bf449352571', 'volume_size': 1} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:35 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139032246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3beb587c-7e61-475b-b8b0-bb76e29cc105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:35Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Creating volume 3beb587c-7e61-475b-b8b0-bb76e29cc105 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:35 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b1edf5-276e-41c1-8b8a-dbb2618a72a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 1073741824 Sep 07 09:57:35 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f1fda5-5a3e-4a40-bb3f-0a28b69243b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Volume volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 (5fc5aae3-1312-47ee-9ca2-828fd1981d88): created successfully Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f1fda5-5a3e-4a40-bb3f-0a28b69243b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (454552c0-ca17-4e79-b353-5335e97e0484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (37f41f49-9036-49a2-8e5c-42d73ebf2045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78cc940-83b0-426c-b5e9-4f60c51efc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d1650a6b-d913-4c8e-8161-62c72065ccaa tempest-CreateVolumesFromImageTest-1756402841 None] Created volume successfully. Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78cc940-83b0-426c-b5e9-4f60c51efc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1798764952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa822157-116c-4f56-9c5e-e2b61592e0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:36Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d95ccef-020b-4f4a-984c-e4291a61327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d95ccef-020b-4f4a-984c-e4291a61327f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ccaf5e-85d7-4350-8e78-0260f10213e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ccaf5e-85d7-4350-8e78-0260f10213e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa822157-116c-4f56-9c5e-e2b61592e0d0', 'volume_name': 'volume-fa822157-116c-4f56-9c5e-e2b61592e0d0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca48ae1-6662-4e94-9004-96909eca6efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca48ae1-6662-4e94-9004-96909eca6efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88287906-4c82-4a7c-b762-ac1f510e0324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Volume fa822157-116c-4f56-9c5e-e2b61592e0d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa822157-116c-4f56-9c5e-e2b61592e0d0', 'volume_size': 1} Sep 07 09:57:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (dec67e7e-93e2-4577-babd-78f9794d2a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826f8b61-0aaf-4f14-bebd-d4c64e2a9df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826f8b61-0aaf-4f14-bebd-d4c64e2a9df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021690960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:36Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee41821e-76fe-4598-b38e-3f8cfd353db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee41821e-76fe-4598-b38e-3f8cfd353db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aea00c-9d05-40ea-aeda-6fcc88814913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aea00c-9d05-40ea-aeda-6fcc88814913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759', 'volume_name': 'volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fac6a8e-1bd4-4e49-a3ec-9aaf95bcf21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fac6a8e-1bd4-4e49-a3ec-9aaf95bcf21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249dec3-49bf-407b-aacb-f08059dcb3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Volume 8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759', 'volume_size': 1} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:36 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 1073741824" returned: 0 in 0.798s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:36 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 Sep 07 09:57:36 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:36 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105" returned: 0 in 0.412s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1362809831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d0e3a3-2940-49f6-a060-2bf449352571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:35Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Creating volume a5d0e3a3-2940-49f6-a060-2bf449352571 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:37 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6335d940-c9f1-466b-8325-b7ab79c2d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3beb587c-7e61-475b-b8b0-bb76e29cc105', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae467af-6ad7-4987-8e1a-2b502bb07471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:37 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 1073741824 Sep 07 09:57:37 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:37 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Volume volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 (3beb587c-7e61-475b-b8b0-bb76e29cc105): created successfully Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae467af-6ad7-4987-8e1a-2b502bb07471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (0527b514-2a76-4ba6-8a3d-7333531e40ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fce7f522-a949-4712-b22a-d02fd5d20be4 tempest-CreateVolumesFromImageTest-1756402841 None] Created volume successfully. Sep 07 09:57:37 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 1073741824" returned: 0 in 0.647s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:37 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 Sep 07 09:57:37 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:38 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571" returned: 0 in 0.308s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1798764952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa822157-116c-4f56-9c5e-e2b61592e0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:36Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Creating volume fa822157-116c-4f56-9c5e-e2b61592e0d0 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:38 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703dc2a0-c649-412b-b9aa-85d38ea74e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d0e3a3-2940-49f6-a060-2bf449352571', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8024594-25c9-48e1-ae6d-ea0ef3a9b4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:38 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 1073741824 Sep 07 09:57:38 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:38 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Volume volume-a5d0e3a3-2940-49f6-a060-2bf449352571 (a5d0e3a3-2940-49f6-a060-2bf449352571): created successfully Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8024594-25c9-48e1-ae6d-ea0ef3a9b4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (df4033df-f955-4701-b9bd-42251bedf316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e7a52d18-c9c3-431a-8d24-db0d8d18b4de tempest-CreateVolumesFromImageTest-1756402841 None] Created volume successfully. Sep 07 09:57:38 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 1073741824" returned: 0 in 0.544s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:38 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 Sep 07 09:57:38 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:38 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0" returned: 0 in 0.340s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.465s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021690960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2878ccb05e7f4f9cb1467133b148e2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:36Z,use_quota=True,user_id='3f5d32d7e54c408198e525c75184d0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Creating volume 8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:39 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88287906-4c82-4a7c-b762-ac1f510e0324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa822157-116c-4f56-9c5e-e2b61592e0d0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:39 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 1073741824 Sep 07 09:57:39 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aacb1ca-043b-4250-a301-e3dbc28f4bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Volume volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 (fa822157-116c-4f56-9c5e-e2b61592e0d0): created successfully Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aacb1ca-043b-4250-a301-e3dbc28f4bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (37f41f49-9036-49a2-8e5c-42d73ebf2045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ff27c979-387c-4683-95c6-7796abeee59e tempest-CreateVolumesFromImageTest-1756402841 None] Created volume successfully. Sep 07 09:57:39 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 1073741824" returned: 0 in 0.536s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:39 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 Sep 07 09:57:39 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:39 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759" returned: 0 in 0.330s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249dec3-49bf-407b-aacb-f08059dcb3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a0a41d-8c85-494c-a4ef-a6c1434beb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Volume volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 (8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759): created successfully Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a0a41d-8c85-494c-a4ef-a6c1434beb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Flow 'volume_create_manager' (dec67e7e-93e2-4577-babd-78f9794d2a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1ba9dacf-9651-458f-a041-8c1640c14c46 tempest-CreateVolumesFromImageTest-1756402841 None] Created volume successfully. Sep 07 09:57:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-quobyte-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:40 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[61717a23-5e57-4d55-8094-73c7a008108f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:41 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 Sep 07 09:57:41 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:41 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:41 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:41 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759" returned: 0 in 0.407s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:41 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759 Sep 07 09:57:41 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:41 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:57:41 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759" returned: 0 in 0.350s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759" released by "delete_volume" :: held 0.816s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Created reservations ['e608502a-2cb7-4bc5-b555-0dda8b0aeb06', '7ec91d98-0f09-482a-ad61-ea6b7600da93', '226654c5-048e-4fe9-8b0d-4a2982f16b02', 'a2597a04-7e72-44b3-b5ee-00d96222a137'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:41 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:41 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-fa822157-116c-4f56-9c5e-e2b61592e0d0-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-fa822157-116c-4f56-9c5e-e2b61592e0d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-quobyte-fa822157-116c-4f56-9c5e-e2b61592e0d0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-fa822157-116c-4f56-9c5e-e2b61592e0d0" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a96d3-6d06-462a-8469-fcaa74b92e63]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:42 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.321s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Deleted volume successfully. Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00719c34-5bff-450b-8d5b-de676d4f63e6 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-8a974b31-4ad0-4d72-8b1d-d1a4bc7d0759-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:42 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 Sep 07 09:57:42 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:42 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0" returned: 0 in 0.380s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:42 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0 Sep 07 09:57:42 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:42 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-fa822157-116c-4f56-9c5e-e2b61592e0d0" returned: 0 in 0.316s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-fa822157-116c-4f56-9c5e-e2b61592e0d0" released by "delete_volume" :: held 0.755s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:42 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Created reservations ['4a57ebe6-30bd-4134-a899-67e227d38eff', '8e904187-05db-425d-8f53-f82cb2b402e3', '5555fe47-70be-4c97-884a-68c2e3682ca4', '65183606-a38c-4a12-95fd-3519d4d44137'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:43 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:43 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-a5d0e3a3-2940-49f6-a060-2bf449352571-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-a5d0e3a3-2940-49f6-a060-2bf449352571-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-quobyte-a5d0e3a3-2940-49f6-a060-2bf449352571" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-a5d0e3a3-2940-49f6-a060-2bf449352571" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c0ef65-2432-4c43-b234-94c46cbda469]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:43 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.352s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Deleted volume successfully. Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8a7b2d15-2761-4ae1-a635-1730131a646d tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-fa822157-116c-4f56-9c5e-e2b61592e0d0-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:43 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 Sep 07 09:57:43 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:43 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571" returned: 0 in 0.397s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:43 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571 Sep 07 09:57:43 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:44 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a5d0e3a3-2940-49f6-a060-2bf449352571" returned: 0 in 0.327s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-a5d0e3a3-2940-49f6-a060-2bf449352571" released by "delete_volume" :: held 0.773s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Created reservations ['1fd7b198-108b-4202-93f7-1236c6417b90', '37854288-09a5-4df5-ba32-3a83617830c4', 'aa760822-4cf7-4e3b-b2b5-ca88b1ba835c', '06842c81-99c1-41c1-a5b7-ac3886809a70'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:44 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:44 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-3beb587c-7e61-475b-b8b0-bb76e29cc105-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-3beb587c-7e61-475b-b8b0-bb76e29cc105-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-quobyte-3beb587c-7e61-475b-b8b0-bb76e29cc105" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-3beb587c-7e61-475b-b8b0-bb76e29cc105" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:44 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.334s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Deleted volume successfully. Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8494711-e8b1-4c30-a8c2-031d68989e45]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f006ad1-ea61-4138-ab5f-6ec84eeca214 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-a5d0e3a3-2940-49f6-a060-2bf449352571-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:44 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 Sep 07 09:57:44 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:45 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105" returned: 0 in 0.493s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:45 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105 Sep 07 09:57:45 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:45 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3beb587c-7e61-475b-b8b0-bb76e29cc105" returned: 0 in 0.385s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-3beb587c-7e61-475b-b8b0-bb76e29cc105" released by "delete_volume" :: held 0.963s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Created reservations ['5742f76c-a86c-4789-892e-cb2f73936f27', 'dd239563-dbe9-4885-960c-4371813b5cb8', 'a113ebd7-dd2e-451a-9be0-789d5c58afa9', '8e732a35-cfef-493e-8c21-75ab9da16c22'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:45 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:45 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:46 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.363s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:46 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Deleted volume successfully. Sep 07 09:57:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b37a7494-82c3-4eac-acfd-bc86afa85835 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-3beb587c-7e61-475b-b8b0-bb76e29cc105-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-5fc5aae3-1312-47ee-9ca2-828fd1981d88-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-5fc5aae3-1312-47ee-9ca2-828fd1981d88-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "cinder-quobyte-5fc5aae3-1312-47ee-9ca2-828fd1981d88" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-5fc5aae3-1312-47ee-9ca2-828fd1981d88" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b25e2-b780-4cf3-9f84-f5b48f0ada1e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:47 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 Sep 07 09:57:47 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:47 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88" returned: 0 in 0.542s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:47 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88 Sep 07 09:57:47 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:47 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5fc5aae3-1312-47ee-9ca2-828fd1981d88" returned: 0 in 0.322s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-quobyte-5fc5aae3-1312-47ee-9ca2-828fd1981d88" released by "delete_volume" :: held 0.937s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Created reservations ['b3880360-f34c-43da-9cca-5f486bae9f20', 'f37170f9-ce99-4736-a4d1-79fc97ff3339', '0245e23e-c87c-45f1-bae6-a5f12cc8db88', '382874ae-023c-47af-a614-46f192b200e0'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:48 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:57:48 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:48 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.313s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:57:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Deleted volume successfully. Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4abcc127-68b5-4eb5-9854-1d24b9ccc9c4 tempest-CreateVolumesFromImageTest-1756402841 None] Lock "cinder-5fc5aae3-1312-47ee-9ca2-828fd1981d88-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (f4c8b8bf-e265-4ee0-ad8d-c55b0180e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff29eae3-fedf-4a14-89b7-6a7a70e71b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff29eae3-fedf-4a14-89b7-6a7a70e71b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-409448527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd55365-05df-40d6-ba4a-f9866655bb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:49Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52691672-63af-4497-b71d-d3cbf4415d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52691672-63af-4497-b71d-d3cbf4415d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a09fcf-02ef-4374-b65a-6c18de483292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a09fcf-02ef-4374-b65a-6c18de483292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd55365-05df-40d6-ba4a-f9866655bb0c', 'volume_name': 'volume-4cd55365-05df-40d6-ba4a-f9866655bb0c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba00c26-35db-4f2e-b0e9-adbb32f43df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba00c26-35db-4f2e-b0e9-adbb32f43df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb7c721-899c-411d-a335-27a2737f215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:48 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume 4cd55365-05df-40d6-ba4a-f9866655bb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd55365-05df-40d6-ba4a-f9866655bb0c', 'volume_size': 1} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-409448527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd55365-05df-40d6-ba4a-f9866655bb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:49Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Creating volume 4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:49 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:49 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c 1073741824 Sep 07 09:57:49 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:49 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c 1073741824" returned: 0 in 0.548s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:49 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c Sep 07 09:57:49 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:49 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c" returned: 0 in 0.284s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb7c721-899c-411d-a335-27a2737f215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd55365-05df-40d6-ba4a-f9866655bb0c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402c6501-9553-4189-a951-e5572fd946d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:49 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume volume-4cd55365-05df-40d6-ba4a-f9866655bb0c (4cd55365-05df-40d6-ba4a-f9866655bb0c): created successfully Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402c6501-9553-4189-a951-e5572fd946d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (f4c8b8bf-e265-4ee0-ad8d-c55b0180e187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:49 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b554a3a5-e1bd-4754-be47-a97bad0b46fd tempest-CreateVolumesFromSnapshotTest-377429488 None] Created volume successfully. Sep 07 09:57:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Creating offline snapshot 492c1a16-172b-4b9c-bfd8-dd21ba380bcc of volume 4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:57:51 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893180f-939d-4ae2-8ca0-85b5aa325df4]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:51 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c Sep 07 09:57:51 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:51 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c" returned: 0 in 0.488s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:52 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc 1G Sep 07 09:57:52 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:52 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc 1G" returned: 0 in 0.594s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd55365-05df-40d6-ba4a-f9866655bb0c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:52 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd55365-05df-40d6-ba4a-f9866655bb0c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc Sep 07 09:57:52 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:52 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd55365-05df-40d6-ba4a-f9866655bb0c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc" returned: 0 in 0.325s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:52 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc is being set with open permissions: ugo+rw Sep 07 09:57:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:52 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc Sep 07 09:57:52 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:53 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc" returned: 0 in 0.321s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:53 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.info Sep 07 09:57:53 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:53 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.info" returned: 0 in 0.320s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:53 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.info is being set with open permissions: ugo+rw Sep 07 09:57:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:53 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.info Sep 07 09:57:53 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:53 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.info" returned: 0 in 0.278s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:53 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f21423be-37e4-45f2-a474-4afa95563958 tempest-CreateVolumesFromSnapshotTest-377429488 None] Create snapshot completed successfully Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (b8021bbb-f836-42e2-a5e9-51f59df49131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef566088-eda3-4d68-8109-f3e8e9744535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef566088-eda3-4d68-8109-f3e8e9744535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683297840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:55Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594083c3-079d-4636-97f2-9e65cbb1d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594083c3-079d-4636-97f2-9e65cbb1d74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d0e997-ac3e-4b5c-89e5-05e440f59671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d0e997-ac3e-4b5c-89e5-05e440f59671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15', 'volume_name': 'volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c043b7b4-b731-49f3-857b-3ef2082cea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c043b7b4-b731-49f3-857b-3ef2082cea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fa2425-c567-45f3-9b6d-4f9706b335f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume 5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15', 'volume_size': 1} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683297840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:55Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Creating volume 5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:55 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:55 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 1073741824 Sep 07 09:57:55 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (86375405-7240-4e4c-a205-bf4bdeab0ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28d453e-ff32-4748-acd1-fd38db1907ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28d453e-ff32-4748-acd1-fd38db1907ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298259937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7ac9d0-9e19-4283-9716-464351d4f283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:56Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3ea157-7fa0-4057-aa79-03f8983b63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3ea157-7fa0-4057-aa79-03f8983b63fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb08eb7-7695-49e7-92ad-1480bbc53437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb08eb7-7695-49e7-92ad-1480bbc53437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7ac9d0-9e19-4283-9716-464351d4f283', 'volume_name': 'volume-2a7ac9d0-9e19-4283-9716-464351d4f283', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e363e226-eecf-43cc-8bc7-5d9a3957008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e363e226-eecf-43cc-8bc7-5d9a3957008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152d470b-4780-43fc-b474-93fe035eb762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:55 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume 2a7ac9d0-9e19-4283-9716-464351d4f283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7ac9d0-9e19-4283-9716-464351d4f283', 'volume_size': 1} Sep 07 09:57:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:56 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 1073741824" returned: 0 in 0.686s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:56 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 Sep 07 09:57:56 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:56 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (ee2d7277-3f49-488a-a9f0-8328ff97ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c53c1c0-d24f-445b-b1e1-c077c3510adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15" returned: 0 in 0.464s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298259937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7ac9d0-9e19-4283-9716-464351d4f283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:56Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Creating volume 2a7ac9d0-9e19-4283-9716-464351d4f283 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:56 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:56 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 1073741824 Sep 07 09:57:56 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c53c1c0-d24f-445b-b1e1-c077c3510adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103940230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b31a246-a603-4b37-9d04-3377ed2afc09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:56Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b039892-7e63-49dc-b802-fbd19b875512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b039892-7e63-49dc-b802-fbd19b875512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d79ab-03f8-49fb-aa3b-2833b89a9e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d79ab-03f8-49fb-aa3b-2833b89a9e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b31a246-a603-4b37-9d04-3377ed2afc09', 'volume_name': 'volume-6b31a246-a603-4b37-9d04-3377ed2afc09', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded40afd-1da4-474f-ad1e-d29426ddaa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded40afd-1da4-474f-ad1e-d29426ddaa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d954cd-c8bc-4766-a131-543b8b28ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume 6b31a246-a603-4b37-9d04-3377ed2afc09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b31a246-a603-4b37-9d04-3377ed2afc09', 'volume_size': 1} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fa2425-c567-45f3-9b6d-4f9706b335f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1c315e-8ff4-4338-a5da-e40ceaeb78ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 (5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15): created successfully Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1c315e-8ff4-4338-a5da-e40ceaeb78ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (b8021bbb-f836-42e2-a5e9-51f59df49131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8ceec3f4-fc93-4f4d-ad1b-7451fa671b60 tempest-CreateVolumesFromSnapshotTest-377429488 None] Created volume successfully. Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Flow 'volume_create_manager' (c7280800-e8f5-4d18-a12c-613c35318624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba7283e-2c56-4cc3-8927-eb09575342a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba7283e-2c56-4cc3-8927-eb09575342a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2092157846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a155f-d97e-4a63-9e13-1dc7c50f3ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4cf58758645b1b7a79d7793f90871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:57Z,use_quota=True,user_id='1ed3defca534453a8689c794fe19244f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4978a0-21ee-45dc-a804-e23244042b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4978a0-21ee-45dc-a804-e23244042b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a7ff3c-3573-4cc5-8339-49115425c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (d75cbf4b-81c3-4fd2-8d16-c8223ca6f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f94e45-1587-428e-89b2-bc02f275eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f94e45-1587-428e-89b2-bc02f275eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104475878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa777d2-8717-48d2-9ec8-6c653f7dbfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:57Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f3fad-ad5c-4029-9520-5228f07811b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f3fad-ad5c-4029-9520-5228f07811b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0697da-25a8-43c7-8c61-6c4725ef5e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0697da-25a8-43c7-8c61-6c4725ef5e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa777d2-8717-48d2-9ec8-6c653f7dbfaf', 'volume_name': 'volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3448db-fd80-4a3b-8591-0d8cf6920469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3448db-fd80-4a3b-8591-0d8cf6920469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985ab2be-4a86-4671-8b40-5614495e596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume aaa777d2-8717-48d2-9ec8-6c653f7dbfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf', 'volume_size': 1} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:57 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 1073741824" returned: 0 in 0.765s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:57 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 Sep 07 09:57:57 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a7ff3c-3573-4cc5-8339-49115425c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '962a155f-d97e-4a63-9e13-1dc7c50f3ced', 'volume_name': 'volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8d0b3b-de00-4f24-969c-952b5b81716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8d0b3b-de00-4f24-969c-952b5b81716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19115c2-6f3b-4a6a-a4d7-01b0874a36e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:57 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Volume 962a155f-d97e-4a63-9e13-1dc7c50f3ced: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Trying to clone 962a155f-d97e-4a63-9e13-1dc7c50f3ced from image 262465d0-5b79-4e49-bcf9-a496a478d70a at location (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 09:57:57 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283" returned: 0 in 0.486s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103940230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b31a246-a603-4b37-9d04-3377ed2afc09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:56Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Creating volume 6b31a246-a603-4b37-9d04-3377ed2afc09 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:57 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:58 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 1073741824 Sep 07 09:57:58 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152d470b-4780-43fc-b474-93fe035eb762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7ac9d0-9e19-4283-9716-464351d4f283', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c1ca17-a5fb-4a11-a8c8-f1c875ba4922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume volume-2a7ac9d0-9e19-4283-9716-464351d4f283 (2a7ac9d0-9e19-4283-9716-464351d4f283): created successfully Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c1ca17-a5fb-4a11-a8c8-f1c875ba4922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (86375405-7240-4e4c-a205-bf4bdeab0ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2d5bc1cd-a8a8-4b3b-90e9-73bc48d5678a tempest-CreateVolumesFromSnapshotTest-377429488 None] Created volume successfully. Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 09:57:58 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Image download 20.69 MB at 20.69 MB/s Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Flow 'volume_create_manager' (ba61386e-e026-4ccb-bd2e-015f805cd8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac88043-a866-4dcd-8532-e33dda9a5eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b23ed5-46f5-4516-b7d0-0c9687c14411]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac88043-a866-4dcd-8532-e33dda9a5eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74669450-7cfb-4a15-84b6-c8a40e53dc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed40651d9bd741ccbd9b21b7ba704bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:58Z,use_quota=True,user_id='382f203a6f2d431f819566a5e54d86de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d554fc70-c6d7-4551-b245-4c2a705c089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d554fc70-c6d7-4551-b245-4c2a705c089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b31f421-ff8e-49aa-9736-c4c50b51ffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (5b9b1c27-38ed-41f7-a88e-29c7f37c949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2452c840-2787-4182-9d1f-017dc49cb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2452c840-2787-4182-9d1f-017dc49cb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730251910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:58Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de58226-072f-4b03-b422-0c45555b03ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de58226-072f-4b03-b422-0c45555b03ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1b9687-412f-4632-a680-545cf546aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1b9687-412f-4632-a680-545cf546aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2', 'volume_name': 'volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fd38f4-bff4-4160-9c88-82a0857d23df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fd38f4-bff4-4160-9c88-82a0857d23df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c2fc9d-4075-4cb7-9218-14dba82e496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume 8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2', 'volume_size': 1} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:58 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD Sep 07 09:57:58 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:58 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 1073741824" returned: 0 in 0.760s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:58 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 Sep 07 09:57:58 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b31f421-ff8e-49aa-9736-c4c50b51ffbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74669450-7cfb-4a15-84b6-c8a40e53dc04', 'volume_name': 'volume-74669450-7cfb-4a15-84b6-c8a40e53dc04', 'volume_size': 1, 'image_id': 'c5f4006e-ca93-4714-a791-f571d719acf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5f4006e-ca93-4714-a791-f571d719acf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e01ad56bb673f7f4804ab34c71ac8a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed40651d9bd741ccbd9b21b7ba704bf0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c05dff82a10e26252e9807f11dd91759614ae3831ed1ddedfdee57b5f7bb50ff3470b822eb3ce4d0182f6f7a3e7057a4ed3e10353f1de4060e661e1e618a6dd', 'id': 'c5f4006e-ca93-4714-a791-f571d719acf9', 'created_at': datetime.datetime(2026, 9, 7, 7, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 57, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5f4006e-ca93-4714-a791-f571d719acf9/file', 'properties': {}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a7057e-7bfb-46eb-8656-2eca0ead5572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a7057e-7bfb-46eb-8656-2eca0ead5572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38696c-8778-4b53-ada8-aff79e7460f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:58 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Volume 74669450-7cfb-4a15-84b6-c8a40e53dc04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74669450-7cfb-4a15-84b6-c8a40e53dc04', 'volume_size': 1, 'image_id': 'c5f4006e-ca93-4714-a791-f571d719acf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5f4006e-ca93-4714-a791-f571d719acf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e01ad56bb673f7f4804ab34c71ac8a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed40651d9bd741ccbd9b21b7ba704bf0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c05dff82a10e26252e9807f11dd91759614ae3831ed1ddedfdee57b5f7bb50ff3470b822eb3ce4d0182f6f7a3e7057a4ed3e10353f1de4060e661e1e618a6dd', 'id': 'c5f4006e-ca93-4714-a791-f571d719acf9', 'created_at': datetime.datetime(2026, 9, 7, 7, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 57, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5f4006e-ca93-4714-a791-f571d719acf9/file', 'properties': {}}, 'image_service': } Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Trying to clone 74669450-7cfb-4a15-84b6-c8a40e53dc04 from image c5f4006e-ca93-4714-a791-f571d719acf9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5f4006e-ca93-4714-a791-f571d719acf9', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 09:57:58 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:58 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a is fetched for user 1ed3defca534453a8689c794fe19244f. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 09:57:59 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Image download 0.00 MB at 0.00 MB/s Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6299d45a-774e-43d7-a84c-58c2c98483fe]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[058e4797-f46e-4ddb-aec4-e50d9de95ff0]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:59 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:59 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD Sep 07 09:57:59 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09" returned: 0 in 0.454s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104475878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa777d2-8717-48d2-9ec8-6c653f7dbfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:57Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Creating volume aaa777d2-8717-48d2-9ec8-6c653f7dbfaf {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:59 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:59 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD Sep 07 09:57:59 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:59 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf 1073741824 Sep 07 09:57:59 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d954cd-c8bc-4766-a131-543b8b28ba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b31a246-a603-4b37-9d04-3377ed2afc09', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec62f37-9ef6-44df-9362-bfdb52c02686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:59 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume volume-6b31a246-a603-4b37-9d04-3377ed2afc09 (6b31a246-a603-4b37-9d04-3377ed2afc09): created successfully Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec62f37-9ef6-44df-9362-bfdb52c02686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (ee2d7277-3f49-488a-a9f0-8328ff97ac07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3ecade06-bbd1-4b32-8c44-e663f88c7562 tempest-CreateVolumesFromSnapshotTest-377429488 None] Created volume successfully. Sep 07 09:57:59 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:59 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:59 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD Sep 07 09:57:59 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:59 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf 1073741824" returned: 0 in 0.496s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:59 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf Sep 07 09:57:59 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:59 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:57:59 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Temporary image c5f4006e-ca93-4714-a791-f571d719acf9 is fetched for user 382f203a6f2d431f819566a5e54d86de. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[182cfe62-63ba-482b-939c-ae86becc92fd]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:00 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf" returned: 0 in 0.289s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.553s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730251910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4ece19c9c24311828759390fe6b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:58Z,use_quota=True,user_id='27293f29cc25403896df1b3977d938f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Creating volume 8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:00 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985ab2be-4a86-4671-8b40-5614495e596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:00 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 1073741824 Sep 07 09:58:00 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0c18ca-bebb-4b27-83fc-4cc838bc4417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:00 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD Sep 07 09:58:00 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:00 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf (aaa777d2-8717-48d2-9ec8-6c653f7dbfaf): created successfully Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0c18ca-bebb-4b27-83fc-4cc838bc4417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (d75cbf4b-81c3-4fd2-8d16-c8223ca6f816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:00 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4e116ccb-470d-49fb-8a80-a8aa79781a8f tempest-CreateVolumesFromSnapshotTest-377429488 None] Created volume successfully. Sep 07 09:58:00 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:00 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD Sep 07 09:58:00 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:00 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 1073741824" returned: 0 in 0.549s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:00 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 Sep 07 09:58:00 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:00 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:00 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2" returned: 0 in 0.264s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2092157846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a155f-d97e-4a63-9e13-1dc7c50f3ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b4cf58758645b1b7a79d7793f90871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:57Z,use_quota=True,user_id='1ed3defca534453a8689c794fe19244f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Creating volume 962a155f-d97e-4a63-9e13-1dc7c50f3ced {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:01 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c2fc9d-4075-4cb7-9218-14dba82e496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0deed6c3-bcdb-4007-b00c-6a4845c770c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:01 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced 1073741824 Sep 07 09:58:01 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:01 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Volume volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 (8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2): created successfully Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0deed6c3-bcdb-4007-b00c-6a4845c770c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Flow 'volume_create_manager' (5b9b1c27-38ed-41f7-a88e-29c7f37c949d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:01 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2fe5a834-a29a-40a3-b428-4e8c6430503f tempest-CreateVolumesFromSnapshotTest-377429488 None] Created volume successfully. Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:01 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced 1073741824" returned: 0 in 0.563s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:01 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced Sep 07 09:58:01 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb309e-21c1-47a0-a5f1-f3fe73d9d1fc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:01 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 Sep 07 09:58:01 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:01 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced" returned: 0 in 0.262s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74669450-7cfb-4a15-84b6-c8a40e53dc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed40651d9bd741ccbd9b21b7ba704bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:58Z,use_quota=True,user_id='382f203a6f2d431f819566a5e54d86de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Creating volume 74669450-7cfb-4a15-84b6-c8a40e53dc04 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:01 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:01 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 1073741824 Sep 07 09:58:01 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:01 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Attempting download of 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 962a155f-d97e-4a63-9e13-1dc7c50f3ced. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae67ba-4a6c-414f-ae66-d86d4db9da25]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_u4x5t4bd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:02 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:02 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2 Sep 07 09:58:02 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:02 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_u4x5t4bd Sep 07 09:58:02 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:02 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2" returned: 0 in 0.275s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2" released by "delete_volume" :: held 0.774s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:02 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 1073741824" returned: 0 in 0.553s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:02 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_u4x5t4bd" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_u4x5t4bd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Created reservations ['68aef5fb-c7f4-4851-b836-dedf7e8aef3b', '9d7490a0-d25c-40a0-88c5-4999bb2f0a4a', '3e35f7c5-c3b7-4c29-b241-0b8629642d0e', '67cb7d94-eb1e-4506-b621-5c55be9e520c'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:02 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 Sep 07 09:58:02 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:02 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_u4x5t4bd Sep 07 09:58:02 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:02 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:02 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:02 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:02 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_u4x5t4bd" returned: 1 in 0.501s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_u4x5t4bd' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9250e942-c7ad-4c77-a0c2-001864ce18e6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:02 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.387s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Deleted volume successfully. Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Attempting download of c5f4006e-ca93-4714-a791-f571d719acf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5f4006e-ca93-4714-a791-f571d719acf9', 'metadata': {}}])) to volume 74669450-7cfb-4a15-84b6-c8a40e53dc04. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b043d66-4f4c-4e51-812c-d7e8f9e9f738]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3369fb1c-dca2-4145-9926-9f3bdef21d0e tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-8ce6f9c5-96a7-4e22-9c57-a1fb8192b1c2-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c8ebc6-0797-4fb7-9c05-f72fef744750]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5f4006e-ca93-4714-a791-f571d719acf9__zy8xh_p {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:03 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD Sep 07 09:58:03 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:03 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf Sep 07 09:58:03 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:03 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5f4006e-ca93-4714-a791-f571d719acf9__zy8xh_p Sep 07 09:58:03 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:03 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf" returned: 0 in 0.472s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:03 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD" returned: 0 in 0.697s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] 262465d0-5b79-4e49-bcf9-a496a478d70a was qcow2, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:03 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf Sep 07 09:58:03 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:03 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5f4006e-ca93-4714-a791-f571d719acf9__zy8xh_p" returned: 0 in 0.474s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5f4006e-ca93-4714-a791-f571d719acf9__zy8xh_p {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:03 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced Sep 07 09:58:03 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:03 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5f4006e-ca93-4714-a791-f571d719acf9__zy8xh_p Sep 07 09:58:03 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:03 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf" returned: 0 in 0.307s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf" released by "delete_volume" :: held 0.863s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Created reservations ['cde1325b-a66f-4879-a187-d9f2c1be449e', '3dffa60d-62eb-469d-9944-55aca4c2a831', '2453b678-b67a-4af8-9554-ee1fd020cd3c', '94a00a4d-37ca-4644-a555-3e0c4eac2ea2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:04 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5f4006e-ca93-4714-a791-f571d719acf9__zy8xh_p" returned: 1 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5f4006e-ca93-4714-a791-f571d719acf9__zy8xh_p' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d08c299-3c3e-4429-9e87-f2ddf49ef61f]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:04 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:04 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:04 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD Sep 07 09:58:04 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:04 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.381s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Deleted volume successfully. Sep 07 09:58:04 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8b6adc5a-c68f-46c4-8864-12303875c062 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-aaa777d2-8717-48d2-9ec8-6c653f7dbfaf-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:04 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD Sep 07 09:58:04 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:04 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] c5f4006e-ca93-4714-a791-f571d719acf9 was raw, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 09:58:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:05 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 Sep 07 09:58:05 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-6b31a246-a603-4b37-9d04-3377ed2afc09-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-6b31a246-a603-4b37-9d04-3377ed2afc09-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-6b31a246-a603-4b37-9d04-3377ed2afc09" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-6b31a246-a603-4b37-9d04-3377ed2afc09" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7214802d-d2a0-4043-b3e6-b0fef27c3e86]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:05 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 Sep 07 09:58:05 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:05 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04" returned: 0 in 0.652s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5f4006e-ca93-4714-a791-f571d719acf9_dbzfb69gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:58:05 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:05 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 1G Sep 07 09:58:05 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:05 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09" returned: 0 in 0.458s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:05 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09 Sep 07 09:58:05 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:06 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced" returned: 0 in 2.460s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_tco1rqu8devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:58:06 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Converted 112.00 MB image at 45.49 MB/s Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:06 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:06 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 1G" returned: 0 in 0.533s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Downloaded image c5f4006e-ca93-4714-a791-f571d719acf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5f4006e-ca93-4714-a791-f571d719acf9', 'metadata': {}}])) to volume 74669450-7cfb-4a15-84b6-c8a40e53dc04 successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Temporary image c5f4006e-ca93-4714-a791-f571d719acf9 for user 382f203a6f2d431f819566a5e54d86de is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Marking volume 74669450-7cfb-4a15-84b6-c8a40e53dc04 as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-6b31a246-a603-4b37-9d04-3377ed2afc09" returned: 0 in 0.346s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:06 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced 1G Sep 07 09:58:06 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Copying metadata from image c5f4006e-ca93-4714-a791-f571d719acf9 to 74669450-7cfb-4a15-84b6-c8a40e53dc04. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Creating volume glance metadata for volume 74669450-7cfb-4a15-84b6-c8a40e53dc04 backed by image c5f4006e-ca93-4714-a791-f571d719acf9 with: {'image_id': 'c5f4006e-ca93-4714-a791-f571d719acf9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e01ad56bb673f7f4804ab34c71ac8a66', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-6b31a246-a603-4b37-9d04-3377ed2afc09" released by "delete_volume" :: held 0.871s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38696c-8778-4b53-ada8-aff79e7460f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74669450-7cfb-4a15-84b6-c8a40e53dc04', 'volume_size': 1, 'image_id': 'c5f4006e-ca93-4714-a791-f571d719acf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5f4006e-ca93-4714-a791-f571d719acf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e01ad56bb673f7f4804ab34c71ac8a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed40651d9bd741ccbd9b21b7ba704bf0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c05dff82a10e26252e9807f11dd91759614ae3831ed1ddedfdee57b5f7bb50ff3470b822eb3ce4d0182f6f7a3e7057a4ed3e10353f1de4060e661e1e618a6dd', 'id': 'c5f4006e-ca93-4714-a791-f571d719acf9', 'created_at': datetime.datetime(2026, 9, 7, 7, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 57, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5f4006e-ca93-4714-a791-f571d719acf9/file', 'properties': {}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a9e99b-5b9f-4757-8167-fbbdeb5c7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:06 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Volume volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 (74669450-7cfb-4a15-84b6-c8a40e53dc04): created successfully Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a9e99b-5b9f-4757-8167-fbbdeb5c7609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Flow 'volume_create_manager' (ba61386e-e026-4ccb-bd2e-015f805cd8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Created reservations ['7d89da4c-2415-4636-bb7a-1ea7ae7bff53', 'df7f4043-73cf-474f-b672-88a9a740ab79', '4ac533c3-3d4c-459c-8c1b-b6caa3d69a7d', '54e8cca3-e3dd-4979-99a5-1101cc9e166b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2a26ca44-b43c-42b1-97dd-5d8a8ad793c0 tempest-VolumeImageDependencyTests-1806954040 None] Created volume successfully. Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-2a7ac9d0-9e19-4283-9716-464351d4f283-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:06 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:06 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-2a7ac9d0-9e19-4283-9716-464351d4f283-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:06 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced 1G" returned: 0 in 0.517s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Downloaded image 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 962a155f-d97e-4a63-9e13-1dc7c50f3ced successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a for user 1ed3defca534453a8689c794fe19244f is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Marking volume 962a155f-d97e-4a63-9e13-1dc7c50f3ced as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Copying metadata from image 262465d0-5b79-4e49-bcf9-a496a478d70a to 962a155f-d97e-4a63-9e13-1dc7c50f3ced. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Creating volume glance metadata for volume 962a155f-d97e-4a63-9e13-1dc7c50f3ced backed by image 262465d0-5b79-4e49-bcf9-a496a478d70a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Acquiring lock "cinder-74669450-7cfb-4a15-84b6-c8a40e53dc04-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-2a7ac9d0-9e19-4283-9716-464351d4f283" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-2a7ac9d0-9e19-4283-9716-464351d4f283" acquired by "delete_volume" :: waited 0.091s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Lock "cinder-74669450-7cfb-4a15-84b6-c8a40e53dc04-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e6798e-a99b-4b1c-b339-3a3f0124af36]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:06 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.364s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Deleted volume successfully. Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Acquiring lock "cinder-quobyte-74669450-7cfb-4a15-84b6-c8a40e53dc04" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d1db8ce3-d267-4d50-ae60-502e5440277c tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-6b31a246-a603-4b37-9d04-3377ed2afc09-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Lock "cinder-quobyte-74669450-7cfb-4a15-84b6-c8a40e53dc04" acquired by "delete_volume" :: waited 0.037s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:07 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 Sep 07 09:58:07 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6d9ce4-ece7-4557-be75-27a7cd3607b6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19115c2-6f3b-4a6a-a4d7-01b0874a36e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587f91d3-0382-48ff-ad34-4dd4ae96312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:07 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Volume volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced (962a155f-d97e-4a63-9e13-1dc7c50f3ced): created successfully Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587f91d3-0382-48ff-ad34-4dd4ae96312e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Flow 'volume_create_manager' (c7280800-e8f5-4d18-a12c-613c35318624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:07 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fe24e2d3-e7db-4249-89c3-ae048d5806f3 tempest-VolumesImageMetadata-157100163 None] Created volume successfully. Sep 07 09:58:07 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 Sep 07 09:58:07 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:07 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:07 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283 Sep 07 09:58:07 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:07 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:07 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04 Sep 07 09:58:07 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:07 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2a7ac9d0-9e19-4283-9716-464351d4f283" returned: 0 in 0.267s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-2a7ac9d0-9e19-4283-9716-464351d4f283" released by "delete_volume" :: held 0.752s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Created reservations ['0294b389-66a4-44c1-a26d-5a3150986428', '3af2a948-da23-4889-9053-e1afd51ec9c5', '234405cb-37ea-4f97-9e2b-b6331170931f', 'b864cc3b-5cca-49ac-8d3e-3dbe1a1c87a3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:07 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74669450-7cfb-4a15-84b6-c8a40e53dc04" returned: 0 in 0.287s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:07 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:07 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Lock "cinder-quobyte-74669450-7cfb-4a15-84b6-c8a40e53dc04" released by "delete_volume" :: held 0.779s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Created reservations ['fa71dc18-a8fb-4126-b208-be984fc1ce91', '77d676c2-7e88-428d-9099-d42e11b1a52d', 'ad9e1e9f-5fb4-460f-b6dc-ed2efc299e94', '21ca6ca0-9ead-46ef-b3d4-29c9c7a35773'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15" acquired by "delete_volume" :: waited 0.070s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:08 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:08 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69b6ae2-60d9-49be-9b1b-c25ed598f999]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:08 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.466s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Deleted volume successfully. Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-7fcc6a73-a19f-4f7d-91c2-c066f75f5387 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-2a7ac9d0-9e19-4283-9716-464351d4f283-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:08 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 Sep 07 09:58:08 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:08 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.448s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Deleted volume successfully. Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-557781c2-2491-4627-a7ec-eb1b8c3c8b21 tempest-VolumeImageDependencyTests-1806954040 None] Lock "cinder-74669450-7cfb-4a15-84b6-c8a40e53dc04-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:08 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15" returned: 0 in 0.587s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:08 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15 Sep 07 09:58:08 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Acquiring lock "cinder-962a155f-d97e-4a63-9e13-1dc7c50f3ced-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Lock "cinder-962a155f-d97e-4a63-9e13-1dc7c50f3ced-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Acquiring lock "cinder-quobyte-962a155f-d97e-4a63-9e13-1dc7c50f3ced" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Lock "cinder-quobyte-962a155f-d97e-4a63-9e13-1dc7c50f3ced" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:09 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15" returned: 0 in 0.418s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95f05a3-7870-4afb-a6ae-044a1760a233]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15" released by "delete_volume" :: held 1.108s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Created reservations ['f772143a-b6b2-4a4e-8fd1-c5cf265f1966', '87934f99-645b-481e-803d-fdf1e43c6d6b', '2776789f-19d9-4fec-8e16-b188068a2b79', 'b5cffadb-151d-4cac-b838-7f645af4af25'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:09 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced Sep 07 09:58:09 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:09 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:09 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:09 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced" returned: 0 in 0.525s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:09 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced Sep 07 09:58:09 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:09 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.333s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Deleted volume successfully. Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ee2ce7f3-35ed-44ba-9f82-37c3e83b0d90 tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-5d11eca3-dbe8-4a4f-8b10-bbd8e2a3bb15-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:09 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-962a155f-d97e-4a63-9e13-1dc7c50f3ced" returned: 0 in 0.286s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Lock "cinder-quobyte-962a155f-d97e-4a63-9e13-1dc7c50f3ced" released by "delete_volume" :: held 0.883s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Created reservations ['4050a06c-fc29-473e-9f42-f90fa85303dd', 'd2ead8ae-2b73-4250-abe9-92c6c97036d6', 'e9b5a8cc-8b66-4744-8cc9-e5140ca60c8d', 'c6c84566-ec8e-42ae-8b31-50fc9831dc07'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:10 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:10 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-492c1a16-172b-4b9c-bfd8-dd21ba380bcc-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-492c1a16-172b-4b9c-bfd8-dd21ba380bcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-4cd55365-05df-40d6-ba4a-f9866655bb0c" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-4cd55365-05df-40d6-ba4a-f9866655bb0c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-492c1a16-172b-4b9c-bfd8-dd21ba380bcc" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-492c1a16-172b-4b9c-bfd8-dd21ba380bcc" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Deleting offline snapshot 492c1a16-172b-4b9c-bfd8-dd21ba380bcc of volume 4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] snapshot_file for this snap is: volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:58:10 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.376s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a536060f-025f-4cc4-9bad-d26a8460c943]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Deleted volume successfully. Sep 07 09:58:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67d44965-b9b3-4e77-9081-50005fc5c323 tempest-VolumesImageMetadata-157100163 None] Lock "cinder-962a155f-d97e-4a63-9e13-1dc7c50f3ced-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:10 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc Sep 07 09:58:10 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:11 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc" returned: 0 in 0.523s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd55365-05df-40d6-ba4a-f9866655bb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:58:11 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0ff531-61b6-4587-8aec-cff06f9ea9b2]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:11 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c Sep 07 09:58:11 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:11 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:11 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc Sep 07 09:58:11 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:11 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc" returned: 0 in 0.421s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:12 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc Sep 07 09:58:12 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:12 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c.492c1a16-172b-4b9c-bfd8-dd21ba380bcc" returned: 0 in 0.299s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-492c1a16-172b-4b9c-bfd8-dd21ba380bcc" released by "_delete_snapshot" :: held 1.853s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-4cd55365-05df-40d6-ba4a-f9866655bb0c" released by "delete_snapshot" :: held 1.908s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Created reservations ['8d06aeec-257c-49a0-a71a-92b61feb4858', 'd025e104-01b3-4e48-8b84-dc77811e44a2', '352e601f-f302-4955-bd1e-362f1d42fa85', '2314f14f-ce67-4aa6-96dd-ab2b4bcbfa54'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Delete snapshot completed successfully. Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b7f5724-83a0-421d-957f-ef4cc3969f8a tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-492c1a16-172b-4b9c-bfd8-dd21ba380bcc-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-4cd55365-05df-40d6-ba4a-f9866655bb0c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-4cd55365-05df-40d6-ba4a-f9866655bb0c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "cinder-quobyte-4cd55365-05df-40d6-ba4a-f9866655bb0c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-4cd55365-05df-40d6-ba4a-f9866655bb0c" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69570e-2d5c-41ed-8fb6-4b08b4d084fe]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:12 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c Sep 07 09:58:12 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:13 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c" returned: 0 in 0.430s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:13 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c Sep 07 09:58:13 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:13 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4cd55365-05df-40d6-ba4a-f9866655bb0c" returned: 0 in 0.275s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-quobyte-4cd55365-05df-40d6-ba4a-f9866655bb0c" released by "delete_volume" :: held 0.772s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Created reservations ['516e213f-03e0-4049-84b1-f62fe39fd202', 'eba07d3a-4afc-4c38-bdd2-d508ea4dc6e0', '7f265b82-ef9a-4946-bb81-443ce6ae052f', '7249a206-b204-44a2-a870-dfb499be08dd'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:13 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:13 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:14 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.332s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:14 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Deleted volume successfully. Sep 07 09:58:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-102efe7b-6a0e-466f-bebd-58c39d62850d tempest-CreateVolumesFromSnapshotTest-377429488 None] Lock "cinder-4cd55365-05df-40d6-ba4a-f9866655bb0c-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=141,cinder:UPDATE=181,cinder:DELETE=14,cinder:INSERT=57 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=201,cinder:INSERT=53,cinder:SELECT=133,cinder:DELETE=19 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Flow 'volume_create_manager' (0d85bebb-cf5b-4b0f-aee8-81f9a062473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136e674e-d927-4684-b3c3-278b067d1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136e674e-d927-4684-b3c3-278b067d1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434358778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cf2945-e956-4e32-b8e2-9d0903d40770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63edfc71ec8e4e849a2cd9b50015aa37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:22Z,use_quota=True,user_id='ad1cd2d778bd4f7fa91fa6d8184896ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678440b8-c6ee-429a-89d9-76ad3f9da099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678440b8-c6ee-429a-89d9-76ad3f9da099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93813c7b-fce3-4d44-a540-f5f2026a3388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93813c7b-fce3-4d44-a540-f5f2026a3388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9cf2945-e956-4e32-b8e2-9d0903d40770', 'volume_name': 'volume-d9cf2945-e956-4e32-b8e2-9d0903d40770', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215de933-ff3d-435f-a6c8-b52e7b6f1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215de933-ff3d-435f-a6c8-b52e7b6f1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4df8096-fb9a-486f-9aad-dce16b7a9e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Volume d9cf2945-e956-4e32-b8e2-9d0903d40770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9cf2945-e956-4e32-b8e2-9d0903d40770', 'volume_size': 1} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434358778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cf2945-e956-4e32-b8e2-9d0903d40770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63edfc71ec8e4e849a2cd9b50015aa37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:22Z,use_quota=True,user_id='ad1cd2d778bd4f7fa91fa6d8184896ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Creating volume d9cf2945-e956-4e32-b8e2-9d0903d40770 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:21 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:21 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 1073741824 Sep 07 09:58:21 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:22 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 1073741824" returned: 0 in 0.540s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:22 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 Sep 07 09:58:22 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:22 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770" returned: 0 in 0.261s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4df8096-fb9a-486f-9aad-dce16b7a9e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9cf2945-e956-4e32-b8e2-9d0903d40770', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00ebac2-44c9-4c62-921e-e94f64fd00ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Volume volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 (d9cf2945-e956-4e32-b8e2-9d0903d40770): created successfully Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00ebac2-44c9-4c62-921e-e94f64fd00ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Flow 'volume_create_manager' (0d85bebb-cf5b-4b0f-aee8-81f9a062473c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:22 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-31928dad-bf40-4581-ba3e-375544d535e6 tempest-VolumesTransfersTest-1470214571 None] Created volume successfully. Sep 07 09:58:24 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-dd1feac3-9cfb-4694-b15d-f8efb3bbeaac tempest-VolumesTransfersTest-1930218621 None] Transfer volume completed successfully. Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Acquiring lock "cinder-d9cf2945-e956-4e32-b8e2-9d0903d40770-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Lock "cinder-d9cf2945-e956-4e32-b8e2-9d0903d40770-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Acquiring lock "cinder-quobyte-d9cf2945-e956-4e32-b8e2-9d0903d40770" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Lock "cinder-quobyte-d9cf2945-e956-4e32-b8e2-9d0903d40770" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058b256-7f1e-48df-aa2c-1d74ca8bf536]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:25 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 Sep 07 09:58:25 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:25 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:25 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770 Sep 07 09:58:25 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:26 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d9cf2945-e956-4e32-b8e2-9d0903d40770" returned: 0 in 0.251s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Lock "cinder-quobyte-d9cf2945-e956-4e32-b8e2-9d0903d40770" released by "delete_volume" :: held 0.715s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Created reservations ['8d9d9598-218e-4265-8cc7-59aa9e382c8a', '1750e2bc-37e9-4533-8301-0de19d2775a1', 'f0359046-3838-4f15-ac6a-6a6de61f4bb9', 'b0bd3d91-cf7e-4c35-b0f4-4e3b919c67e9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:26 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:26 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:26 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.300s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Deleted volume successfully. Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5649d2bf-bb2f-4238-9ae3-9acfd379195c tempest-VolumesTransfersTest-600108917 None] Lock "cinder-d9cf2945-e956-4e32-b8e2-9d0903d40770-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:26 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Flow 'volume_create_manager' (4fd5e476-5e5f-4847-b461-da7ca06c2cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016e5493-ce11-45a1-96d5-9dbf0c423286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016e5493-ce11-45a1-96d5-9dbf0c423286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1919134657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684bdeae-d3bc-4c8a-a04c-0e7c03588adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63edfc71ec8e4e849a2cd9b50015aa37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:27Z,use_quota=True,user_id='ad1cd2d778bd4f7fa91fa6d8184896ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b179c5-b1a6-4c47-b4e8-499b312fb9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b179c5-b1a6-4c47-b4e8-499b312fb9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ba15b0-3bfa-4afe-a03a-82b631aaad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ba15b0-3bfa-4afe-a03a-82b631aaad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684bdeae-d3bc-4c8a-a04c-0e7c03588adc', 'volume_name': 'volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e9dfdf-1baf-4860-be44-bbc5681907c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e9dfdf-1baf-4860-be44-bbc5681907c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdacf4ef-39e4-4a96-82be-aa635ea4f6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:27 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Volume 684bdeae-d3bc-4c8a-a04c-0e7c03588adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc', 'volume_size': 1} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1919134657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684bdeae-d3bc-4c8a-a04c-0e7c03588adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63edfc71ec8e4e849a2cd9b50015aa37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:27Z,use_quota=True,user_id='ad1cd2d778bd4f7fa91fa6d8184896ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Creating volume 684bdeae-d3bc-4c8a-a04c-0e7c03588adc {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:27 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:27 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc 1073741824 Sep 07 09:58:27 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:27 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc 1073741824" returned: 0 in 0.450s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:27 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc Sep 07 09:58:27 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:27 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc" returned: 0 in 0.266s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdacf4ef-39e4-4a96-82be-aa635ea4f6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91227ac2-bd13-4d06-b265-767444fa632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:27 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Volume volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc (684bdeae-d3bc-4c8a-a04c-0e7c03588adc): created successfully Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91227ac2-bd13-4d06-b265-767444fa632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Flow 'volume_create_manager' (4fd5e476-5e5f-4847-b461-da7ca06c2cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-809ff4a5-f9ae-4912-960d-febf7e0cef3d tempest-VolumesTransfersTest-1470214571 None] Created volume successfully. Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Flow 'volume_create_manager' (9ac77eba-c90d-4d96-ab36-4c733f89f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc60518-e0ee-4e35-8cac-dfbfec97c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc60518-e0ee-4e35-8cac-dfbfec97c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1615708809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10218c0e-2b02-4d19-b4f5-ed1d5fab5b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e97c29acec4db4b387c81d437ec4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:29Z,use_quota=True,user_id='a29617c061e5453088778e06d6a843eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce308e9f-bcb5-4757-a9c5-21c22c53d118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce308e9f-bcb5-4757-a9c5-21c22c53d118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7001f3d2-45cb-4273-b7ea-767a3ce74d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Acquiring lock "cinder-684bdeae-d3bc-4c8a-a04c-0e7c03588adc-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Lock "cinder-684bdeae-d3bc-4c8a-a04c-0e7c03588adc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Acquiring lock "cinder-quobyte-684bdeae-d3bc-4c8a-a04c-0e7c03588adc" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Lock "cinder-quobyte-684bdeae-d3bc-4c8a-a04c-0e7c03588adc" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbf46ac-8867-461a-9a5c-e33482719e39]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7001f3d2-45cb-4273-b7ea-767a3ce74d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10218c0e-2b02-4d19-b4f5-ed1d5fab5b36', 'volume_name': 'volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfba6b28-6e03-430a-8f8a-f0ff476f3b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:29 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfba6b28-6e03-430a-8f8a-f0ff476f3b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:29 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2539f6b1-a54c-4eab-b2c8-fc9698430bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:29 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Volume 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Trying to clone 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 from image 262465d0-5b79-4e49-bcf9-a496a478d70a at location (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 09:58:29 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc" returned: 0 in 0.386s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:29 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc Sep 07 09:58:29 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 09:58:29 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Image download 20.69 MB at 20.69 MB/s Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d292fee-cc3b-4b1f-915e-40c0503d9bd5]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:30 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD Sep 07 09:58:30 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:30 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-684bdeae-d3bc-4c8a-a04c-0e7c03588adc" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Lock "cinder-quobyte-684bdeae-d3bc-4c8a-a04c-0e7c03588adc" released by "delete_volume" :: held 0.723s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Created reservations ['3b3b9060-2bb7-4728-b534-3a8a557185e9', '4076611f-e9b1-4363-bb2f-b9d0d133631f', 'be9fecad-de31-4ad4-a119-2d1b7555f980', '7c316e86-aadc-4e46-be10-d386a9b1fa38'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:30 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:30 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:30 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a is fetched for user a29617c061e5453088778e06d6a843eb. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb810a8d-f91a-46ad-bc75-fbabb9aac75d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:30 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.267s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Deleted volume successfully. Sep 07 09:58:30 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD Sep 07 09:58:30 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-13b1b018-d885-4580-a8d0-7af7cc58f1b1 tempest-VolumesTransfersTest-600108917 None] Lock "cinder-684bdeae-d3bc-4c8a-a04c-0e7c03588adc-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:30 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1615708809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10218c0e-2b02-4d19-b4f5-ed1d5fab5b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e97c29acec4db4b387c81d437ec4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:29Z,use_quota=True,user_id='a29617c061e5453088778e06d6a843eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Creating volume 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:30 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:30 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 1073741824 Sep 07 09:58:30 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:31 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 1073741824" returned: 0 in 0.486s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:31 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 Sep 07 09:58:31 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:31 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36" returned: 0 in 0.254s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Attempting download of 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5312d363-4773-4e0a-9903-6fc1c8cedab3]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_whyuyrln {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:31 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_whyuyrln Sep 07 09:58:31 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:32 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_whyuyrln" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_whyuyrln {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:32 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_whyuyrln Sep 07 09:58:32 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:32 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_whyuyrln" returned: 1 in 0.376s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262465d0-5b79-4e49-bcf9-a496a478d70a_whyuyrln' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d5c4d6-e036-49c1-b15b-5845e9f85659]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:32 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD Sep 07 09:58:32 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:32 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] 262465d0-5b79-4e49-bcf9-a496a478d70a was qcow2, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 09:58:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:32 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 Sep 07 09:58:32 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:34 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36" returned: 0 in 1.843s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:34 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_262465d0-5b79-4e49-bcf9-a496a478d70a_gd4hhrendevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:58:34 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Converted 112.00 MB image at 60.72 MB/s Sep 07 09:58:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:34 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 1G Sep 07 09:58:34 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:34 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 1G" returned: 0 in 0.329s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:34 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Downloaded image 262465d0-5b79-4e49-bcf9-a496a478d70a ((None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}])) to volume 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 09:58:34 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Temporary image 262465d0-5b79-4e49-bcf9-a496a478d70a for user a29617c061e5453088778e06d6a843eb is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 09:58:34 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Marking volume 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 09:58:35 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Copying metadata from image 262465d0-5b79-4e49-bcf9-a496a478d70a to 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 09:58:35 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Creating volume glance metadata for volume 10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 backed by image 262465d0-5b79-4e49-bcf9-a496a478d70a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 09:58:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2539f6b1-a54c-4eab-b2c8-fc9698430bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36', 'volume_size': 1, 'image_id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262465d0-5b79-4e49-bcf9-a496a478d70a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8904304634349ddb5f1ae94716190c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '262465d0-5b79-4e49-bcf9-a496a478d70a', 'created_at': datetime.datetime(2026, 9, 7, 7, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 38, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262465d0-5b79-4e49-bcf9-a496a478d70a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63890966-3774-4981-bf12-c399d7ba77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Volume volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 (10218c0e-2b02-4d19-b4f5-ed1d5fab5b36): created successfully Sep 07 09:58:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63890966-3774-4981-bf12-c399d7ba77d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Flow 'volume_create_manager' (9ac77eba-c90d-4d96-ab36-4c733f89f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-35d2d1cc-3002-42b4-9a44-93853d606882 tempest-TestShelveInstance-1541977130 None] Created volume successfully. Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-6666254f-e152-47d8-b1e1-e36fcb7aef9d req-6031ea5d-2734-4636-b034-4dc877e9b4c4 tempest-TestShelveInstance-1541977130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-6666254f-e152-47d8-b1e1-e36fcb7aef9d req-6031ea5d-2734-4636-b034-4dc877e9b4c4 tempest-TestShelveInstance-1541977130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-6666254f-e152-47d8-b1e1-e36fcb7aef9d req-6031ea5d-2734-4636-b034-4dc877e9b4c4 tempest-TestShelveInstance-1541977130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-6666254f-e152-47d8-b1e1-e36fcb7aef9d req-6031ea5d-2734-4636-b034-4dc877e9b4c4 tempest-TestShelveInstance-1541977130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e004fd7e-91bc-4bc1-b02c-b65da0e5bd24', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:58:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-6666254f-e152-47d8-b1e1-e36fcb7aef9d req-6031ea5d-2734-4636-b034-4dc877e9b4c4 tempest-TestShelveInstance-1541977130 None] attachment_update completed successfully. Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Flow 'volume_create_manager' (ab44d62e-6502-44ca-94c8-e4427cf77bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d376f5eb-fe35-4336-8aaa-2225634d31f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d376f5eb-fe35-4336-8aaa-2225634d31f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1395886319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93cb24d-00d4-42dc-9b96-34ea1413257b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4ae3e7ec8748db821642c52565ba46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:38Z,use_quota=True,user_id='42d3f6375ef04fc28d006837d54650b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e507df3e-8cd0-44d0-90de-8966ee8cbec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e507df3e-8cd0-44d0-90de-8966ee8cbec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19bc568-2da7-4fbd-b7be-b79529292213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19bc568-2da7-4fbd-b7be-b79529292213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93cb24d-00d4-42dc-9b96-34ea1413257b', 'volume_name': 'volume-b93cb24d-00d4-42dc-9b96-34ea1413257b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfebf284-bdda-4d99-8443-2c458048faf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfebf284-bdda-4d99-8443-2c458048faf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cab4a95-76c2-4f1b-a20a-fdc3006e680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:38 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Volume b93cb24d-00d4-42dc-9b96-34ea1413257b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93cb24d-00d4-42dc-9b96-34ea1413257b', 'volume_size': 1} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1395886319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93cb24d-00d4-42dc-9b96-34ea1413257b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4ae3e7ec8748db821642c52565ba46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:38Z,use_quota=True,user_id='42d3f6375ef04fc28d006837d54650b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Creating volume b93cb24d-00d4-42dc-9b96-34ea1413257b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:38 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:38 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b 1073741824 Sep 07 09:58:38 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:39 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b 1073741824" returned: 0 in 0.513s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:39 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b Sep 07 09:58:39 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:39 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b" returned: 0 in 0.273s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cab4a95-76c2-4f1b-a20a-fdc3006e680b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93cb24d-00d4-42dc-9b96-34ea1413257b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84253de-34d4-4420-9e46-c5e8d7d50a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Volume volume-b93cb24d-00d4-42dc-9b96-34ea1413257b (b93cb24d-00d4-42dc-9b96-34ea1413257b): created successfully Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84253de-34d4-4420-9e46-c5e8d7d50a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Flow 'volume_create_manager' (ab44d62e-6502-44ca-94c8-e4427cf77bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-53b96125-e4cc-4429-8cd1-9631e1a7afd8 tempest-VolumesTransfersV357Test-1455168709 None] Created volume successfully. Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:41 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:41 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:41 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.468s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:58:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:58:41 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1ec8054b-771f-458b-ad13-8adca3352311 tempest-VolumesTransfersV357Test-424579428 None] Transfer volume completed successfully. Sep 07 09:58:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Acquiring lock "cinder-b93cb24d-00d4-42dc-9b96-34ea1413257b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-b93cb24d-00d4-42dc-9b96-34ea1413257b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Acquiring lock "cinder-quobyte-b93cb24d-00d4-42dc-9b96-34ea1413257b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-quobyte-b93cb24d-00d4-42dc-9b96-34ea1413257b" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6acaef-78ff-4503-b0fb-eb754600aec8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:42 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b Sep 07 09:58:42 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:43 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b" returned: 0 in 0.409s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:43 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b Sep 07 09:58:43 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:43 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b93cb24d-00d4-42dc-9b96-34ea1413257b" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-quobyte-b93cb24d-00d4-42dc-9b96-34ea1413257b" released by "delete_volume" :: held 0.743s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Created reservations ['75ae1559-f5f8-4cb8-bcae-6cee2bbf7cf7', '98c579df-37f6-445f-bc59-a1e6387e5dea', 'bd37fabf-406e-4412-916e-633120b7a2ed', '7f23a8f0-271f-47d8-a43c-1a8f7e5800e2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:43 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:43 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:43 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.304s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Deleted volume successfully. Sep 07 09:58:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-c58e1cd7-f91d-41ff-bf13-07171a90c45d tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-b93cb24d-00d4-42dc-9b96-34ea1413257b-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Flow 'volume_create_manager' (d269ffe4-907b-4578-847a-aaa6b2e78aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5706c4-91fa-424a-bfc4-2bc5531ead3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5706c4-91fa-424a-bfc4-2bc5531ead3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-385218391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f892ae75-dd35-4d96-aae6-74f47425d7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4ae3e7ec8748db821642c52565ba46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:44Z,use_quota=True,user_id='42d3f6375ef04fc28d006837d54650b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761479c7-3500-41f1-832d-b59b10631847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761479c7-3500-41f1-832d-b59b10631847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf94a43-2adf-4f92-b5b9-686f9382721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf94a43-2adf-4f92-b5b9-686f9382721a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f892ae75-dd35-4d96-aae6-74f47425d7cf', 'volume_name': 'volume-f892ae75-dd35-4d96-aae6-74f47425d7cf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df41753-83ae-4269-afd9-72a1440d43c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df41753-83ae-4269-afd9-72a1440d43c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dab976-7c0a-4904-95b3-9da3c7cdc762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:44 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Volume f892ae75-dd35-4d96-aae6-74f47425d7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f892ae75-dd35-4d96-aae6-74f47425d7cf', 'volume_size': 1} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-385218391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f892ae75-dd35-4d96-aae6-74f47425d7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4ae3e7ec8748db821642c52565ba46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:44Z,use_quota=True,user_id='42d3f6375ef04fc28d006837d54650b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Creating volume f892ae75-dd35-4d96-aae6-74f47425d7cf {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:44 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:44 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf 1073741824 Sep 07 09:58:44 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:45 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf 1073741824" returned: 0 in 0.492s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:45 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf Sep 07 09:58:45 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:45 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf" returned: 0 in 0.310s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dab976-7c0a-4904-95b3-9da3c7cdc762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f892ae75-dd35-4d96-aae6-74f47425d7cf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2b38e5-4b05-4716-9d9a-6bc30cbbedd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:45 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Volume volume-f892ae75-dd35-4d96-aae6-74f47425d7cf (f892ae75-dd35-4d96-aae6-74f47425d7cf): created successfully Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2b38e5-4b05-4716-9d9a-6bc30cbbedd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Flow 'volume_create_manager' (d269ffe4-907b-4578-847a-aaa6b2e78aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-094a9038-0919-4f19-8ee4-ab1be09e176a tempest-VolumesTransfersV357Test-1455168709 None] Created volume successfully. Sep 07 09:58:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Acquiring lock "cinder-f892ae75-dd35-4d96-aae6-74f47425d7cf-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-f892ae75-dd35-4d96-aae6-74f47425d7cf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Acquiring lock "cinder-quobyte-f892ae75-dd35-4d96-aae6-74f47425d7cf" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-quobyte-f892ae75-dd35-4d96-aae6-74f47425d7cf" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:46 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b926dc-833c-4c3e-beaa-fe136a1ab544]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:47 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf Sep 07 09:58:47 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:47 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf" returned: 0 in 0.422s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:47 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf Sep 07 09:58:47 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:47 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f892ae75-dd35-4d96-aae6-74f47425d7cf" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-quobyte-f892ae75-dd35-4d96-aae6-74f47425d7cf" released by "delete_volume" :: held 0.736s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Created reservations ['a29e0ab8-7f70-4350-9c00-912a99c2192e', 'c7338181-aa83-4743-9bd8-f68dadc51192', 'c8a4e979-4d37-4f41-baa6-ac0a3a65e803', '56575283-f55a-4eee-915e-1038ad6e81a1'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:47 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:58:47 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:48 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:48 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Deleted volume successfully. Sep 07 09:58:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e1f66372-0729-4cf2-a57f-83baad0a2bee tempest-VolumesTransfersV357Test-1924500316 None] Lock "cinder-f892ae75-dd35-4d96-aae6-74f47425d7cf-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Flow 'volume_create_manager' (7b2f8e37-595a-4727-9f36-62bc18bb4232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21f8e3f-f67f-4642-8904-b0149c49d268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21f8e3f-f67f-4642-8904-b0149c49d268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-838159107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2917cb4-a986-482c-b5a3-6a8e6265f72d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e57e453e1143479def00391a482c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:54Z,use_quota=True,user_id='83b46df887b14edf86776704328ea9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0195f389-ec45-45d5-a4d5-98f9538046ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0195f389-ec45-45d5-a4d5-98f9538046ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a2ab5c-b2d5-4ed4-9000-c33247a5017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a2ab5c-b2d5-4ed4-9000-c33247a5017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2917cb4-a986-482c-b5a3-6a8e6265f72d', 'volume_name': 'volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe59f86-267f-4f59-85bf-648c08172e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe59f86-267f-4f59-85bf-648c08172e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640b3537-ba80-4790-9621-753b03c40e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Volume f2917cb4-a986-482c-b5a3-6a8e6265f72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d', 'volume_size': 1} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-838159107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2917cb4-a986-482c-b5a3-6a8e6265f72d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e57e453e1143479def00391a482c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:54Z,use_quota=True,user_id='83b46df887b14edf86776704328ea9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Creating volume f2917cb4-a986-482c-b5a3-6a8e6265f72d {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:54 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:54 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d 1073741824 Sep 07 09:58:54 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:55 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d 1073741824" returned: 0 in 0.408s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:55 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d Sep 07 09:58:55 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:55 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640b3537-ba80-4790-9621-753b03c40e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6a083f-5fc8-44e5-aff5-978d73a01781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:55 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Volume volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d (f2917cb4-a986-482c-b5a3-6a8e6265f72d): created successfully Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6a083f-5fc8-44e5-aff5-978d73a01781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Flow 'volume_create_manager' (7b2f8e37-595a-4727-9f36-62bc18bb4232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6c488f44-d96e-42de-824e-0f85e8757466 tempest-VolumesListTestJSON-36127412 None] Created volume successfully. Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Flow 'volume_create_manager' (dd7e4a16-5b9d-48d1-a48b-9ecadaeb62b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563cc753-fb9b-41f2-ab43-cfafbc4e25a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563cc753-fb9b-41f2-ab43-cfafbc4e25a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2086753633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8809c10-9add-4c9b-be5f-0483f92de80c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e57e453e1143479def00391a482c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:56Z,use_quota=True,user_id='83b46df887b14edf86776704328ea9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957b82c-5919-41f4-8ded-1181d1e119ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957b82c-5919-41f4-8ded-1181d1e119ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3bb9ac-fd70-4a5c-b386-bbb4cc15574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3bb9ac-fd70-4a5c-b386-bbb4cc15574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8809c10-9add-4c9b-be5f-0483f92de80c', 'volume_name': 'volume-b8809c10-9add-4c9b-be5f-0483f92de80c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e9c9f-5ef1-423d-b87b-ede1eb44b030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736e9c9f-5ef1-423d-b87b-ede1eb44b030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aaedd2-72cf-49e0-8af7-ea841ea7f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Volume b8809c10-9add-4c9b-be5f-0483f92de80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8809c10-9add-4c9b-be5f-0483f92de80c', 'volume_size': 1} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2086753633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8809c10-9add-4c9b-be5f-0483f92de80c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e57e453e1143479def00391a482c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:56Z,use_quota=True,user_id='83b46df887b14edf86776704328ea9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Creating volume b8809c10-9add-4c9b-be5f-0483f92de80c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:56 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:56 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c 1073741824 Sep 07 09:58:56 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:56 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c 1073741824" returned: 0 in 0.488s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:56 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c Sep 07 09:58:56 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:57 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c" returned: 0 in 0.320s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aaedd2-72cf-49e0-8af7-ea841ea7f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8809c10-9add-4c9b-be5f-0483f92de80c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a123e46-c14b-4082-9b2c-ec4293f53380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:57 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Volume volume-b8809c10-9add-4c9b-be5f-0483f92de80c (b8809c10-9add-4c9b-be5f-0483f92de80c): created successfully Sep 07 09:58:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a123e46-c14b-4082-9b2c-ec4293f53380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Flow 'volume_create_manager' (dd7e4a16-5b9d-48d1-a48b-9ecadaeb62b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-73403514-9788-4a10-afff-74ebede0c296 tempest-VolumesListTestJSON-36127412 None] Created volume successfully. Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Flow 'volume_create_manager' (98b34481-5ab0-48ab-9d53-b0c419a4382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7f1aca-c2d9-498b-9e96-714b805b5348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7f1aca-c2d9-498b-9e96-714b805b5348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1503629073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ec2cc6-1681-4c5c-9b20-b6e5336b7d74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e57e453e1143479def00391a482c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:59Z,use_quota=True,user_id='83b46df887b14edf86776704328ea9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06405054-1f09-4733-adc1-2fbbf22d138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06405054-1f09-4733-adc1-2fbbf22d138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a69bec-2a0a-40fb-994c-e789f5fdb119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a69bec-2a0a-40fb-994c-e789f5fdb119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ec2cc6-1681-4c5c-9b20-b6e5336b7d74', 'volume_name': 'volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f8f5e6-a2c3-414a-9d03-6e169b267e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f8f5e6-a2c3-414a-9d03-6e169b267e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc80bfbf-29d0-4248-9ca1-881340d0e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:58 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Volume 72ec2cc6-1681-4c5c-9b20-b6e5336b7d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74', 'volume_size': 1} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1503629073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ec2cc6-1681-4c5c-9b20-b6e5336b7d74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e57e453e1143479def00391a482c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:59Z,use_quota=True,user_id='83b46df887b14edf86776704328ea9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Creating volume 72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:58 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:58:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:58 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 1073741824 Sep 07 09:58:58 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:59 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 1073741824" returned: 0 in 0.401s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:59 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 Sep 07 09:58:59 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:59 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc80bfbf-29d0-4248-9ca1-881340d0e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb14ea65-eeca-4661-966a-482987e1f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:59 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Volume volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 (72ec2cc6-1681-4c5c-9b20-b6e5336b7d74): created successfully Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb14ea65-eeca-4661-966a-482987e1f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Flow 'volume_create_manager' (98b34481-5ab0-48ab-9d53-b0c419a4382d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7ec2ce8b-6d6d-45a7-b6b5-1183d73b96d3 tempest-VolumesListTestJSON-36127412 None] Created volume successfully. Sep 07 09:59:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "cinder-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Lock "cinder-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "cinder-quobyte-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Lock "cinder-quobyte-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:01 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[24593f68-5f07-46d2-aa6a-070edff7773c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:01 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 Sep 07 09:59:01 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:02 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74" returned: 0 in 0.385s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:02 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74 Sep 07 09:59:02 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:02 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74" returned: 0 in 0.262s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Lock "cinder-quobyte-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74" released by "delete_volume" :: held 0.688s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Created reservations ['807615d0-fdec-45c5-991e-5ba747da836e', '33f90188-7182-46f2-a885-25b1425494f7', '61f00288-038a-4881-bb41-590e39264424', '415ae701-80d1-4dbc-812b-f3a62ad9bc03'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:02 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:02 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:02 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Deleted volume successfully. Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-81245658-1b87-471b-8c5a-f505a45f9282 tempest-VolumesListTestJSON-36127412 None] Lock "cinder-72ec2cc6-1681-4c5c-9b20-b6e5336b7d74-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Acquiring lock "cinder-b8809c10-9add-4c9b-be5f-0483f92de80c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Lock "cinder-b8809c10-9add-4c9b-be5f-0483f92de80c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Acquiring lock "cinder-quobyte-b8809c10-9add-4c9b-be5f-0483f92de80c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Lock "cinder-quobyte-b8809c10-9add-4c9b-be5f-0483f92de80c" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a09b00-cbf3-4426-a0c2-797d104a511d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:03 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c Sep 07 09:59:03 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:03 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c" returned: 0 in 0.364s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:03 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c Sep 07 09:59:03 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:03 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b8809c10-9add-4c9b-be5f-0483f92de80c" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Lock "cinder-quobyte-b8809c10-9add-4c9b-be5f-0483f92de80c" released by "delete_volume" :: held 0.659s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Created reservations ['a1e5eecf-4c38-4c43-a677-8c97da96bd48', '58424df1-c7ca-4e20-a5e4-1e8da51d06cf', '3e8c5a89-1c5f-4ccc-b4f3-559cb189553b', '6f01c2ea-f489-4b25-8ec6-8e60fdc7a16a'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:03 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:03 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:03 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:03 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Deleted volume successfully. Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d0fa3a1a-7466-418e-93bc-4d357a86d84a tempest-VolumesListTestJSON-36127412 None] Lock "cinder-b8809c10-9add-4c9b-be5f-0483f92de80c-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Acquiring lock "cinder-f2917cb4-a986-482c-b5a3-6a8e6265f72d-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Lock "cinder-f2917cb4-a986-482c-b5a3-6a8e6265f72d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Acquiring lock "cinder-quobyte-f2917cb4-a986-482c-b5a3-6a8e6265f72d" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Lock "cinder-quobyte-f2917cb4-a986-482c-b5a3-6a8e6265f72d" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76036c-2146-4ceb-89b1-996a4bfe34aa]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:04 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d Sep 07 09:59:04 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:04 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d" returned: 0 in 0.347s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:04 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d Sep 07 09:59:04 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:04 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-f2917cb4-a986-482c-b5a3-6a8e6265f72d" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Lock "cinder-quobyte-f2917cb4-a986-482c-b5a3-6a8e6265f72d" released by "delete_volume" :: held 0.639s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Created reservations ['018426bd-1a53-4bf8-bb81-9b75185faaa1', '0cda8947-6194-42f3-bcc2-160290cb716e', '267e8905-6590-42f8-8695-08e5e137b5f8', '53a66937-aef8-4770-9bb3-df27b3e6abff'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:04 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:04 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:05 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.238s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:05 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Deleted volume successfully. Sep 07 09:59:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-46bcde45-2fed-48f4-8011-3824458aa92c tempest-VolumesListTestJSON-36127412 None] Lock "cinder-f2917cb4-a986-482c-b5a3-6a8e6265f72d-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (59d4cab3-5022-4c2a-93af-f4cbd9b2fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d818c4f-b92b-4b82-afd3-f416079f5f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d818c4f-b92b-4b82-afd3-f416079f5f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2015499846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42be7b41-677a-4426-9be3-4889058f5350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:08Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29df18a-dd76-47fd-b9fa-f5f739c0757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29df18a-dd76-47fd-b9fa-f5f739c0757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb457ca-75ec-4c3b-a236-0fc0eb883d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb457ca-75ec-4c3b-a236-0fc0eb883d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42be7b41-677a-4426-9be3-4889058f5350', 'volume_name': 'volume-42be7b41-677a-4426-9be3-4889058f5350', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bac8820-41a4-4d58-87a0-ec4be1e1de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bac8820-41a4-4d58-87a0-ec4be1e1de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f407dc3-b392-46d1-abef-e136812dde59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume 42be7b41-677a-4426-9be3-4889058f5350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42be7b41-677a-4426-9be3-4889058f5350', 'volume_size': 1} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2015499846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42be7b41-677a-4426-9be3-4889058f5350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:08Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Creating volume 42be7b41-677a-4426-9be3-4889058f5350 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:08 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:08 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 1073741824 Sep 07 09:59:08 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:09 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 1073741824" returned: 0 in 0.429s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:09 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 Sep 07 09:59:09 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:09 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f407dc3-b392-46d1-abef-e136812dde59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42be7b41-677a-4426-9be3-4889058f5350', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cad432-2bf1-47c7-8b5c-596edfa553a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume volume-42be7b41-677a-4426-9be3-4889058f5350 (42be7b41-677a-4426-9be3-4889058f5350): created successfully Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cad432-2bf1-47c7-8b5c-596edfa553a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (59d4cab3-5022-4c2a-93af-f4cbd9b2fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-afaa125f-1c49-406d-8214-2097d907165c tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created volume successfully. Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (76d19a51-6646-4b23-9b2e-d451f852748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9ea904-8538-42d7-aea8-1a31cece1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9ea904-8538-42d7-aea8-1a31cece1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909522050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04642dc-72df-4486-a1ad-7f7577b44ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:10Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594ccc73-78e2-4c90-9f4a-e9235d32e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594ccc73-78e2-4c90-9f4a-e9235d32e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8f4c8e-3e9c-4661-8e0b-cfc689dfda5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8f4c8e-3e9c-4661-8e0b-cfc689dfda5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04642dc-72df-4486-a1ad-7f7577b44ded', 'volume_name': 'volume-a04642dc-72df-4486-a1ad-7f7577b44ded', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8501a1c-fe46-4c27-83b1-1d6c01c94e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8501a1c-fe46-4c27-83b1-1d6c01c94e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25765d1e-810d-421d-8458-6a88f1f5102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume a04642dc-72df-4486-a1ad-7f7577b44ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04642dc-72df-4486-a1ad-7f7577b44ded', 'volume_size': 1} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909522050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04642dc-72df-4486-a1ad-7f7577b44ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:10Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Creating volume a04642dc-72df-4486-a1ad-7f7577b44ded {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:09 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:10 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded 1073741824 Sep 07 09:59:10 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (827fcdfc-d716-47da-abd6-ec5e9d33fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910c21a1-5b09-49d3-b294-b99629dd487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910c21a1-5b09-49d3-b294-b99629dd487f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1745598147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a584fce9-bf0c-4e88-b58c-23d06917cdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:10Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138d1f8c-28d0-40eb-8c02-1b9c8996de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138d1f8c-28d0-40eb-8c02-1b9c8996de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1171403-efa7-49b2-8af6-d7e87f0b30c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1171403-efa7-49b2-8af6-d7e87f0b30c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a584fce9-bf0c-4e88-b58c-23d06917cdcd', 'volume_name': 'volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f158f303-d860-411e-a7c4-de1831f85daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f158f303-d860-411e-a7c4-de1831f85daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f1ea84-13f2-4b6a-a7ac-88857930176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume a584fce9-bf0c-4e88-b58c-23d06917cdcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd', 'volume_size': 1} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:10 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded 1073741824" returned: 0 in 0.488s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:10 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded Sep 07 09:59:10 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (019e5a35-ee42-4375-8bec-23e1c05d3a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081539d3-2b83-41e1-9369-a75a6f23c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081539d3-2b83-41e1-9369-a75a6f23c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246788289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:11Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cbf420-f518-4684-a4a4-c85a086f998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cbf420-f518-4684-a4a4-c85a086f998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245365b5-7590-479e-980e-26ae29127673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245365b5-7590-479e-980e-26ae29127673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e', 'volume_name': 'volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa219ffc-9a10-4851-9f54-694e4817c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa219ffc-9a10-4851-9f54-694e4817c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1704a4-4931-4426-9bff-a1c07627c06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume 8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e', 'volume_size': 1} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:10 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded" returned: 0 in 0.277s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1745598147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a584fce9-bf0c-4e88-b58c-23d06917cdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:10Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Creating volume a584fce9-bf0c-4e88-b58c-23d06917cdcd {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:10 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:10 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd 1073741824 Sep 07 09:59:10 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25765d1e-810d-421d-8458-6a88f1f5102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04642dc-72df-4486-a1ad-7f7577b44ded', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf090f5f-05fd-4628-8cb6-634230989747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume volume-a04642dc-72df-4486-a1ad-7f7577b44ded (a04642dc-72df-4486-a1ad-7f7577b44ded): created successfully Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf090f5f-05fd-4628-8cb6-634230989747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (76d19a51-6646-4b23-9b2e-d451f852748f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1deccc1a-de71-4e76-b1ed-d69fb1a97933 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created volume successfully. Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (2158d17d-4499-4402-9ffd-4fea7c601a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b649b-35cf-440b-93b1-402c98462f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b649b-35cf-440b-93b1-402c98462f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844367585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6bbba3-09cf-499b-9efa-a57abbf9fc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:11Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f10f7c-80c5-4669-bddc-492687942bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f10f7c-80c5-4669-bddc-492687942bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde43206-6b66-4ddf-a365-1c1adca9b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde43206-6b66-4ddf-a365-1c1adca9b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6bbba3-09cf-499b-9efa-a57abbf9fc39', 'volume_name': 'volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c216571-6a2d-4184-ab5d-6f7ed987f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c216571-6a2d-4184-ab5d-6f7ed987f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857f6a3e-e6f0-4c25-9c73-4a09809b28b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume 7f6bbba3-09cf-499b-9efa-a57abbf9fc39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39', 'volume_size': 1} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:11 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd 1073741824" returned: 0 in 0.529s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:11 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd Sep 07 09:59:11 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (874d5729-d452-4804-9caa-5f96d5549e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15aee2a3-38fb-4245-acbc-445a326f9dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15aee2a3-38fb-4245-acbc-445a326f9dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375019262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:11Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f294b8-fb34-4da9-9aa0-7b4643cca267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f294b8-fb34-4da9-9aa0-7b4643cca267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91b2c80-e8e7-430a-b1b5-86e0fb8e3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91b2c80-e8e7-430a-b1b5-86e0fb8e3494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3', 'volume_name': 'volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c8d5b9-1fbc-49cf-bfcd-e359b49f25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c8d5b9-1fbc-49cf-bfcd-e359b49f25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b2aed8-5f06-41a9-a6f5-30d78b4d867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume 37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3', 'volume_size': 1} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:11 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246788289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:11Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Creating volume 8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:11 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:11 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e 1073741824 Sep 07 09:59:11 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f1ea84-13f2-4b6a-a7ac-88857930176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb06094-8a87-4f62-86f7-cb52461bc8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd (a584fce9-bf0c-4e88-b58c-23d06917cdcd): created successfully Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb06094-8a87-4f62-86f7-cb52461bc8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (827fcdfc-d716-47da-abd6-ec5e9d33fe21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a1a7f5bd-61ee-4e73-83f3-23228cf0828d tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created volume successfully. Sep 07 09:59:12 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e 1073741824" returned: 0 in 0.410s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:12 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e Sep 07 09:59:12 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:12 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844367585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6bbba3-09cf-499b-9efa-a57abbf9fc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:11Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Creating volume 7f6bbba3-09cf-499b-9efa-a57abbf9fc39 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:12 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1704a4-4931-4426-9bff-a1c07627c06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:12 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 1073741824 Sep 07 09:59:12 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697735ee-4951-46c9-86fd-3a1fc36fc76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e (8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e): created successfully Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697735ee-4951-46c9-86fd-3a1fc36fc76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (019e5a35-ee42-4375-8bec-23e1c05d3a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-96d4247c-d4d0-49f3-b380-51ee0303bf45 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created volume successfully. Sep 07 09:59:12 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 1073741824" returned: 0 in 0.471s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:12 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 Sep 07 09:59:12 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:13 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39" returned: 0 in 0.251s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375019262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc97d71b5d46f5975a0b91be5fe512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:11Z,use_quota=True,user_id='e4845664cc3a4e6a8fd8d925b45b3da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Creating volume 37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:13 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857f6a3e-e6f0-4c25-9c73-4a09809b28b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:13 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 1073741824 Sep 07 09:59:13 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf29af-4d4d-43b6-99c8-ed85a4700a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 (7f6bbba3-09cf-499b-9efa-a57abbf9fc39): created successfully Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf29af-4d4d-43b6-99c8-ed85a4700a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (2158d17d-4499-4402-9ffd-4fea7c601a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-319eafc6-8025-4070-b8e9-31512f26eb60 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created volume successfully. Sep 07 09:59:13 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 1073741824" returned: 0 in 0.424s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:13 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 Sep 07 09:59:13 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:13 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3" returned: 0 in 0.251s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b2aed8-5f06-41a9-a6f5-30d78b4d867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69271872-5e23-43fb-a204-82f7da1d9c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Volume volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 (37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3): created successfully Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69271872-5e23-43fb-a204-82f7da1d9c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Flow 'volume_create_manager' (874d5729-d452-4804-9caa-5f96d5549e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-edb50d2f-fc1e-400b-9fac-399ea661e1d4 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created volume successfully. Sep 07 09:59:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-quobyte-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3" acquired by "delete_volume" :: waited 0.013s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:14 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc031222-1609-4a54-bf8b-d4ec1ca0dc0e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:15 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 Sep 07 09:59:15 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:15 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3" returned: 0 in 0.347s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:15 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3 Sep 07 09:59:15 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:15 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3" returned: 0 in 0.241s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3" released by "delete_volume" :: held 0.625s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created reservations ['21335083-b604-4733-b8e7-ae5344964d91', '833ebd70-22c7-4720-bbfb-e7b670375ee3', '2cbec513-3480-4919-bbbd-8522204694a2', 'e07d8bdc-eb8f-4ef7-9dc6-d42f10e7fa22'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:15 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:15 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:15 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.235s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Deleted volume successfully. Sep 07 09:59:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-809908d1-54b5-47f4-80bf-f08ea813352b tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-37dbc5ed-26a2-4c8d-9cdb-c3afb9ba39b3-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-7f6bbba3-09cf-499b-9efa-a57abbf9fc39-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-7f6bbba3-09cf-499b-9efa-a57abbf9fc39-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-quobyte-7f6bbba3-09cf-499b-9efa-a57abbf9fc39" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-7f6bbba3-09cf-499b-9efa-a57abbf9fc39" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fe1f5e-7530-445c-acbd-c2bc6532af51]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:16 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 Sep 07 09:59:16 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:16 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39" returned: 0 in 0.361s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:16 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39 Sep 07 09:59:16 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:16 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7f6bbba3-09cf-499b-9efa-a57abbf9fc39" returned: 0 in 0.248s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-7f6bbba3-09cf-499b-9efa-a57abbf9fc39" released by "delete_volume" :: held 0.648s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created reservations ['d9d55d42-65e6-43d5-980c-d2ccc05cfdc8', 'b68177f7-6e7b-4eb2-847a-b12036bbae94', '6835ca19-d7b2-491e-8ef2-508d05eb4aae', 'c69e36f9-91bd-4db7-b6d0-45994cf1d1ab'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:16 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:16 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:17 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.264s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Deleted volume successfully. Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ac4234d7-1a38-4d5a-93df-2d15433f6527 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-7f6bbba3-09cf-499b-9efa-a57abbf9fc39-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-quobyte-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e" acquired by "delete_volume" :: waited 0.013s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ce58a4-718f-4094-8b72-a7d3ce758e16]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:17 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e Sep 07 09:59:17 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:17 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e" returned: 0 in 0.339s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:17 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e Sep 07 09:59:17 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:17 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e" returned: 0 in 0.246s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e" released by "delete_volume" :: held 0.623s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created reservations ['ed34e62f-1291-434a-9f99-14b1640a3351', 'bcd24af4-d067-4447-b8fd-eed8778e66d6', 'ed34eeef-8f18-4ecb-b7e1-71a6d181be8d', 'a96617eb-f97a-427e-a80e-548fff57b712'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:18 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:18 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:18 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.247s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Deleted volume successfully. Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b559fe53-dbc9-4754-8243-9e814996c717 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-8bedcaac-ad6f-4737-a96e-dfabb8ec0e2e-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-a584fce9-bf0c-4e88-b58c-23d06917cdcd-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-a584fce9-bf0c-4e88-b58c-23d06917cdcd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-quobyte-a584fce9-bf0c-4e88-b58c-23d06917cdcd" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-a584fce9-bf0c-4e88-b58c-23d06917cdcd" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[123248fc-9149-4c34-8066-d86f29ff4e26]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:18 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd Sep 07 09:59:18 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:18 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd" returned: 0 in 0.347s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:18 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd Sep 07 09:59:18 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:19 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a584fce9-bf0c-4e88-b58c-23d06917cdcd" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-a584fce9-bf0c-4e88-b58c-23d06917cdcd" released by "delete_volume" :: held 0.628s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created reservations ['32a348d8-cea4-4136-8331-8047fecc9d02', '517ed287-4261-43ce-8a79-49796443e850', 'c9f7eeda-88cf-4fa7-8aa4-d84f2deec438', 'a3193a21-f6df-4813-94a1-70b0cd741cf0'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:19 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:19 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:19 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.239s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:19 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Deleted volume successfully. Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d231ff91-bb8a-48cb-9b66-b0daa5be248a tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-a584fce9-bf0c-4e88-b58c-23d06917cdcd-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-a04642dc-72df-4486-a1ad-7f7577b44ded-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-a04642dc-72df-4486-a1ad-7f7577b44ded-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-quobyte-a04642dc-72df-4486-a1ad-7f7577b44ded" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-a04642dc-72df-4486-a1ad-7f7577b44ded" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f9d52f-d5e8-46e7-b234-454453f72010]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:19 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded Sep 07 09:59:19 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:19 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded" returned: 0 in 0.344s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:19 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded Sep 07 09:59:19 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:20 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-a04642dc-72df-4486-a1ad-7f7577b44ded" returned: 0 in 0.234s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-a04642dc-72df-4486-a1ad-7f7577b44ded" released by "delete_volume" :: held 0.613s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created reservations ['9ca00366-1445-4621-8262-2e74f79fc324', 'fca8d830-08d4-48ce-a72a-4e2468afe77a', '30c8215f-1507-41e1-8056-feabc8a27e87', 'fb3ed283-3247-4b43-8dac-2fb3e7331fc1'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:20 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:20 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:20 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.245s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Deleted volume successfully. Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e87fe1d2-82e9-4ad1-be30-a87cd27c11c0 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-a04642dc-72df-4486-a1ad-7f7577b44ded-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-42be7b41-677a-4426-9be3-4889058f5350-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-42be7b41-677a-4426-9be3-4889058f5350-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "cinder-quobyte-42be7b41-677a-4426-9be3-4889058f5350" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-42be7b41-677a-4426-9be3-4889058f5350" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b7127-acf6-4477-a890-33161b5f9b03]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:20 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 Sep 07 09:59:20 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:21 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350" returned: 0 in 0.361s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:21 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350 Sep 07 09:59:21 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:21 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-42be7b41-677a-4426-9be3-4889058f5350" returned: 0 in 0.239s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-quobyte-42be7b41-677a-4426-9be3-4889058f5350" released by "delete_volume" :: held 0.636s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Created reservations ['fd0e58e6-0198-4e36-82c9-bf7da8020fdf', 'e07bc59d-f7a4-4adc-8086-3c3fe210f65a', 'ecaa0b94-077b-4a0f-8541-b3bd29ad2875', '60f0bd0d-c5c4-4210-b408-61f053d9a09d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:21 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:21 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:21 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.246s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Deleted volume successfully. Sep 07 09:59:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-024d3061-d245-4835-a981-4d5047a25d44 tempest-CreateVolumesFromSourceVolumeTest-38394907 None] Lock "cinder-42be7b41-677a-4426-9be3-4889058f5350-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=105,cinder:UPDATE=150,cinder:DELETE=11,cinder:INSERT=45 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=112,cinder:INSERT=34,cinder:UPDATE=149,cinder:DELETE=16 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Flow 'volume_create_manager' (762548c4-a6b7-4269-9296-660a66256b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4666a9ad-ee38-4893-a004-6d920c6699ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4666a9ad-ee38-4893-a004-6d920c6699ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1369979728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c74b6aa-deea-4c1b-91bc-61db4683a598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c4b4c39c544d7d93c99663fe4d13a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:25Z,use_quota=True,user_id='3831550dae2e4cdfa18a7916a6f262b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e11e1a-10b8-4bfd-8aac-3ac50b18364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e11e1a-10b8-4bfd-8aac-3ac50b18364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef66a1a-8861-44b1-963a-5da7e860d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef66a1a-8861-44b1-963a-5da7e860d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c74b6aa-deea-4c1b-91bc-61db4683a598', 'volume_name': 'volume-2c74b6aa-deea-4c1b-91bc-61db4683a598', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d74f223-b28c-403b-8e9d-a3533be73623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d74f223-b28c-403b-8e9d-a3533be73623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2997ca-e4be-4784-9caa-3590d79a0962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:25 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Volume 2c74b6aa-deea-4c1b-91bc-61db4683a598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c74b6aa-deea-4c1b-91bc-61db4683a598', 'volume_size': 1} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1369979728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c74b6aa-deea-4c1b-91bc-61db4683a598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c4b4c39c544d7d93c99663fe4d13a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:25Z,use_quota=True,user_id='3831550dae2e4cdfa18a7916a6f262b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Creating volume 2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:25 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-fbc146c5-bc53-46b9-9568-fa7535512dc3 req-4ce48c81-0803-4151-bd38-b359b587a4be tempest-TestShelveInstance-1541977130 None] Terminate volume connection completed successfully. Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-fbc146c5-bc53-46b9-9568-fa7535512dc3 req-4ce48c81-0803-4151-bd38-b359b587a4be tempest-TestShelveInstance-1541977130 None] Deleting attachment e004fd7e-91bc-4bc1-b02c-b65da0e5bd24. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:59:25 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 1073741824 Sep 07 09:59:25 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:25 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 1073741824" returned: 0 in 0.475s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:25 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 Sep 07 09:59:25 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:25 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598" returned: 0 in 0.257s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2997ca-e4be-4784-9caa-3590d79a0962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c74b6aa-deea-4c1b-91bc-61db4683a598', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44db9d9b-7a8a-4228-a812-e3d3e5fec053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:26 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Volume volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 (2c74b6aa-deea-4c1b-91bc-61db4683a598): created successfully Sep 07 09:59:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44db9d9b-7a8a-4228-a812-e3d3e5fec053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Flow 'volume_create_manager' (762548c4-a6b7-4269-9296-660a66256b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bcee483d-e065-4459-8b1e-71384c14c202 tempest-VolumeDependencyTests-266713869 None] Created volume successfully. Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a0534cf8-7711-4cee-8ff4-5fdebb5527a4 req-3fba8039-1200-45c8-9376-7ee4e93d6f77 tempest-TestShelveInstance-1541977130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a0534cf8-7711-4cee-8ff4-5fdebb5527a4 req-3fba8039-1200-45c8-9376-7ee4e93d6f77 tempest-TestShelveInstance-1541977130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-a0534cf8-7711-4cee-8ff4-5fdebb5527a4 req-3fba8039-1200-45c8-9376-7ee4e93d6f77 tempest-TestShelveInstance-1541977130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-a0534cf8-7711-4cee-8ff4-5fdebb5527a4 req-3fba8039-1200-45c8-9376-7ee4e93d6f77 tempest-TestShelveInstance-1541977130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07fa7724-612f-4ff7-91a9-e2e8aa4d0784', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:59:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-a0534cf8-7711-4cee-8ff4-5fdebb5527a4 req-3fba8039-1200-45c8-9376-7ee4e93d6f77 tempest-TestShelveInstance-1541977130 None] attachment_update completed successfully. Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Creating offline snapshot ad808369-d284-4578-b009-27e9283d6933 of volume 2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[609023d7-82d0-4435-afc9-d610f191ff5c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:27 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 Sep 07 09:59:27 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:27 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598" returned: 0 in 0.387s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:27 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 1G Sep 07 09:59:27 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:28 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 1G" returned: 0 in 0.426s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:28 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 Sep 07 09:59:28 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:28 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933" returned: 0 in 0.343s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:28 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 is being set with open permissions: ugo+rw Sep 07 09:59:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:28 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 Sep 07 09:59:28 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:28 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:28 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.info Sep 07 09:59:28 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:29 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.info" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:29 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.info is being set with open permissions: ugo+rw Sep 07 09:59:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:29 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.info Sep 07 09:59:29 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:29 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.info" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-79cdbc9b-ff48-49e7-bea9-53ace465f735 tempest-VolumeDependencyTests-266713869 None] Create snapshot completed successfully Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Flow 'volume_create_manager' (ddc2bbf6-0c18-48df-92a0-d2753f6b4a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4376da-089a-4170-9179-d06e274b26ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4376da-089a-4170-9179-d06e274b26ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1947439005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f7f7cf-18a3-4d12-82e0-272914ef13c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c4b4c39c544d7d93c99663fe4d13a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad808369-d284-4578-b009-27e9283d6933,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:31Z,use_quota=True,user_id='3831550dae2e4cdfa18a7916a6f262b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6adf49e-9fda-4333-b651-ff097ef1ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6adf49e-9fda-4333-b651-ff097ef1ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759cefa3-c473-4bc2-900b-47ebe0fc249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759cefa3-c473-4bc2-900b-47ebe0fc249a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45f7f7cf-18a3-4d12-82e0-272914ef13c2', 'volume_name': 'volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2', 'volume_size': 1, 'snapshot_id': 'ad808369-d284-4578-b009-27e9283d6933'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c637c11d-e862-4431-8ef4-848b6d7083aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c637c11d-e862-4431-8ef4-848b6d7083aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8aa59d-eec1-4388-9dae-4d56fd669ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:31 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Volume 45f7f7cf-18a3-4d12-82e0-272914ef13c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2', 'volume_size': 1, 'snapshot_id': 'ad808369-d284-4578-b009-27e9283d6933'} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-quobyte-ad808369-d284-4578-b009-27e9283d6933-45f7f7cf-18a3-4d12-82e0-272914ef13c2" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-ad808369-d284-4578-b009-27e9283d6933-45f7f7cf-18a3-4d12-82e0-272914ef13c2" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Creating volume 45f7f7cf-18a3-4d12-82e0-272914ef13c2 from snapshot ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-quobyte-45f7f7cf-18a3-4d12-82e0-272914ef13c2" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-45f7f7cf-18a3-4d12-82e0-272914ef13c2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] snapshot: ad808369-d284-4578-b009-27e9283d6933, volume: 45f7f7cf-18a3-4d12-82e0-272914ef13c2, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50b361f-1d95-4b7d-909f-734620736417]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:31 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 Sep 07 09:59:31 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:31 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c74b6aa-deea-4c1b-91bc-61db4683a598(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff7b0b-4c6c-4cc8-8447-fa1b58eb3429]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:31 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 Sep 07 09:59:31 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:32 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:59:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:59:32 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:59:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:32 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 Sep 07 09:59:32 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:37 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2" returned: 0 in 5.467s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:37 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:59:37 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Converted 1024.00 MB image at 187.25 MB/s Sep 07 09:59:37 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 is being set with open permissions: ugo+rw Sep 07 09:59:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:37 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 Sep 07 09:59:37 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:37 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2" returned: 0 in 0.239s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-45f7f7cf-18a3-4d12-82e0-272914ef13c2" released by "_copy_volume_from_snapshot" :: held 6.665s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-ad808369-d284-4578-b009-27e9283d6933-45f7f7cf-18a3-4d12-82e0-272914ef13c2" released by "_create_volume_from_snapshot" :: held 6.734s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.754s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8aa59d-eec1-4388-9dae-4d56fd669ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2', 'volume_size': 1, 'snapshot_id': 'ad808369-d284-4578-b009-27e9283d6933'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9637ac87-4991-429d-9fca-f8537acc09c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:38 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Volume volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 (45f7f7cf-18a3-4d12-82e0-272914ef13c2): created successfully Sep 07 09:59:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9637ac87-4991-429d-9fca-f8537acc09c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:38 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Flow 'volume_create_manager' (ddc2bbf6-0c18-48df-92a0-d2753f6b4a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:38 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d5648dd1-4ce4-4723-8582-3c8ae622ecb3 tempest-VolumeDependencyTests-266713869 None] Created volume successfully. Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-ad808369-d284-4578-b009-27e9283d6933-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-ad808369-d284-4578-b009-27e9283d6933-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-quobyte-2c74b6aa-deea-4c1b-91bc-61db4683a598" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-2c74b6aa-deea-4c1b-91bc-61db4683a598" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-quobyte-ad808369-d284-4578-b009-27e9283d6933" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-ad808369-d284-4578-b009-27e9283d6933" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Deleting offline snapshot ad808369-d284-4578-b009-27e9283d6933 of volume 2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] snapshot_file for this snap is: volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e9d341-35bf-4169-894a-940bd6b8dba8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:39 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 Sep 07 09:59:39 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:39 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933" returned: 0 in 0.350s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c74b6aa-deea-4c1b-91bc-61db4683a598(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aee241-af5d-41ea-9d9d-2a613481ae58]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:39 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 Sep 07 09:59:39 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:40 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598" returned: 0 in 0.579s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:40 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 Sep 07 09:59:40 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:40 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933" returned: 0 in 0.336s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:40 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933 Sep 07 09:59:40 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:40 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598.ad808369-d284-4578-b009-27e9283d6933" returned: 0 in 0.246s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-ad808369-d284-4578-b009-27e9283d6933" released by "_delete_snapshot" :: held 1.600s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-2c74b6aa-deea-4c1b-91bc-61db4683a598" released by "delete_snapshot" :: held 1.625s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Created reservations ['9b7dc910-905a-43f8-bc3a-b18990ba491f', '8def9f8c-d0c6-4caa-ab55-cd874aae2186', '4fdc4d47-ebc0-4960-8878-70d5b303a574', '35280a34-e5c2-456f-97a4-2b111991e309'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Delete snapshot completed successfully. Sep 07 09:59:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-66b17ff3-b85e-4568-adf7-dc3ba792b132 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-ad808369-d284-4578-b009-27e9283d6933-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:41 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:41 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-2c74b6aa-deea-4c1b-91bc-61db4683a598-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-2c74b6aa-deea-4c1b-91bc-61db4683a598-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-quobyte-2c74b6aa-deea-4c1b-91bc-61db4683a598" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-2c74b6aa-deea-4c1b-91bc-61db4683a598" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63bfd71-4498-4fb4-a1fb-42e0a4d926f8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:41 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.324s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:59:41 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 Sep 07 09:59:41 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:41 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598" returned: 0 in 0.370s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:41 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598 Sep 07 09:59:41 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:42 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2c74b6aa-deea-4c1b-91bc-61db4683a598" returned: 0 in 0.245s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-2c74b6aa-deea-4c1b-91bc-61db4683a598" released by "delete_volume" :: held 0.685s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Created reservations ['a4a28dcf-0d9d-4d58-81e2-6e2819843f3d', '37a2119e-0174-4557-be1e-4f9f48fc62b6', '64ed9a53-d237-4e9d-84ef-e879352fad3a', 'b7dd0fd1-9bed-4c0d-8c52-5bd0012e4ad3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:42 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:42 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-45f7f7cf-18a3-4d12-82e0-272914ef13c2-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-45f7f7cf-18a3-4d12-82e0-272914ef13c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:42 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.336s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Deleted volume successfully. Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f5e1544a-6abf-4754-8d5b-46a8c75474d0 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-2c74b6aa-deea-4c1b-91bc-61db4683a598-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "cinder-quobyte-45f7f7cf-18a3-4d12-82e0-272914ef13c2" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-45f7f7cf-18a3-4d12-82e0-272914ef13c2" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d702bac0-90f0-4a1b-99ce-6257dd39c8ff]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:42 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 Sep 07 09:59:42 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:43 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2" returned: 0 in 0.392s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:43 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2 Sep 07 09:59:43 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:43 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-45f7f7cf-18a3-4d12-82e0-272914ef13c2" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-quobyte-45f7f7cf-18a3-4d12-82e0-272914ef13c2" released by "delete_volume" :: held 0.691s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Created reservations ['83acc4d3-91c2-47f2-930b-9b192b00015d', '5e642052-dfd3-4b03-9afe-c9e9d1e8bcc3', '72a3e3c9-6f16-4c56-979e-ab844134e888', 'fba05ae4-7873-4571-bcbd-d8185b0469da'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:43 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:43 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:43 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:43 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Deleted volume successfully. Sep 07 09:59:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-37e6fab2-b775-47d7-b33f-ef38a548e539 tempest-VolumeDependencyTests-266713869 None] Lock "cinder-45f7f7cf-18a3-4d12-82e0-272914ef13c2-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Flow 'volume_create_manager' (3ecdecf7-7815-4f69-b75e-566b7f0d59a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da96ddf-e01e-4b5a-8d3a-1206ef35ab50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da96ddf-e01e-4b5a-8d3a-1206ef35ab50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b489da-1d48-4773-a1da-b7ded16d01e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='075a6f5062254efe8b7cb83f79ed1010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:47Z,use_quota=True,user_id='c46bf3b006994223b2f9c87d8b74e47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcc5cd0-ba28-46e4-8297-e4d0ae6d6009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcc5cd0-ba28-46e4-8297-e4d0ae6d6009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b6356a-d430-489e-b53b-470279c12754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b6356a-d430-489e-b53b-470279c12754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b489da-1d48-4773-a1da-b7ded16d01e0', 'volume_name': 'volume-74b489da-1d48-4773-a1da-b7ded16d01e0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273bf29-76f2-4cd2-bc97-a151eac1fc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273bf29-76f2-4cd2-bc97-a151eac1fc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732c18ae-ef79-4b20-ab63-25c9d4d9369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:46 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Volume 74b489da-1d48-4773-a1da-b7ded16d01e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b489da-1d48-4773-a1da-b7ded16d01e0', 'volume_size': 1} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b489da-1d48-4773-a1da-b7ded16d01e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='075a6f5062254efe8b7cb83f79ed1010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:47Z,use_quota=True,user_id='c46bf3b006994223b2f9c87d8b74e47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Creating volume 74b489da-1d48-4773-a1da-b7ded16d01e0 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:46 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:46 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 1073741824 Sep 07 09:59:46 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:47 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 1073741824" returned: 0 in 0.468s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:47 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 Sep 07 09:59:47 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:47 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732c18ae-ef79-4b20-ab63-25c9d4d9369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b489da-1d48-4773-a1da-b7ded16d01e0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6283d23b-0691-4ef8-8a31-3d073a31d178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:47 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Volume volume-74b489da-1d48-4773-a1da-b7ded16d01e0 (74b489da-1d48-4773-a1da-b7ded16d01e0): created successfully Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6283d23b-0691-4ef8-8a31-3d073a31d178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Flow 'volume_create_manager' (3ecdecf7-7815-4f69-b75e-566b7f0d59a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1b5d0a9a-989b-4844-b1eb-44bda6b5c929 tempest-CinderUnicodeTest-283655236 None] Created volume successfully. Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Flow 'volume_create_manager' (eaa80196-85c6-42bb-bf7e-921a69cf07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506d8cbc-fdb3-47a3-8b89-a5e11a7c47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506d8cbc-fdb3-47a3-8b89-a5e11a7c47fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-919376784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503f3dc4-0265-404f-9fa8-742f11ae8bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='075a6f5062254efe8b7cb83f79ed1010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:49Z,use_quota=True,user_id='c46bf3b006994223b2f9c87d8b74e47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5518075-e8b0-48ff-8fb7-df82093fcc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5518075-e8b0-48ff-8fb7-df82093fcc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9c6656-d56b-4a72-9356-f437cf27bca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9c6656-d56b-4a72-9356-f437cf27bca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503f3dc4-0265-404f-9fa8-742f11ae8bef', 'volume_name': 'volume-503f3dc4-0265-404f-9fa8-742f11ae8bef', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a18e8b9-ddd9-4920-a66f-952365046699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a18e8b9-ddd9-4920-a66f-952365046699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f41f160-77cc-4fd5-bbdb-a1b76f7dff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:49 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Volume 503f3dc4-0265-404f-9fa8-742f11ae8bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503f3dc4-0265-404f-9fa8-742f11ae8bef', 'volume_size': 1} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-919376784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503f3dc4-0265-404f-9fa8-742f11ae8bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='075a6f5062254efe8b7cb83f79ed1010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:49Z,use_quota=True,user_id='c46bf3b006994223b2f9c87d8b74e47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Creating volume 503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:49 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:49 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef 1073741824 Sep 07 09:59:49 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:49 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef 1073741824" returned: 0 in 0.432s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:49 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef Sep 07 09:59:49 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:50 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f41f160-77cc-4fd5-bbdb-a1b76f7dff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503f3dc4-0265-404f-9fa8-742f11ae8bef', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d817c4f7-78a6-4049-a586-f72537d1e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:50 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Volume volume-503f3dc4-0265-404f-9fa8-742f11ae8bef (503f3dc4-0265-404f-9fa8-742f11ae8bef): created successfully Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d817c4f7-78a6-4049-a586-f72537d1e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Flow 'volume_create_manager' (eaa80196-85c6-42bb-bf7e-921a69cf07d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:50 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2ddfb781-3839-4eab-ad56-1aeb186bbd37 tempest-CinderUnicodeTest-283655236 None] Created volume successfully. Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Creating offline snapshot 1fbb5068-7bc3-4e36-993b-9dd010a4156c of volume 503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[641e617c-062a-425a-9285-feca52996bae]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:50 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef Sep 07 09:59:50 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:50 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef" returned: 0 in 0.358s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:50 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c 1G Sep 07 09:59:50 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:51 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c 1G" returned: 0 in 0.390s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503f3dc4-0265-404f-9fa8-742f11ae8bef -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:51 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503f3dc4-0265-404f-9fa8-742f11ae8bef -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c Sep 07 09:59:51 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:51 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503f3dc4-0265-404f-9fa8-742f11ae8bef -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c" returned: 0 in 0.291s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:51 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c is being set with open permissions: ugo+rw Sep 07 09:59:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:51 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c Sep 07 09:59:51 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:51 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c" returned: 0 in 0.239s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:51 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.info Sep 07 09:59:51 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:52 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.info" returned: 0 in 0.248s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:52 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.info is being set with open permissions: ugo+rw Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:52 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.info Sep 07 09:59:52 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:52 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.info" returned: 0 in 0.237s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:52 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d46e77e6-c061-4808-8dd5-694cb536c9ed tempest-CinderUnicodeTest-283655236 None] Create snapshot completed successfully Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "cinder-1fbb5068-7bc3-4e36-993b-9dd010a4156c-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-1fbb5068-7bc3-4e36-993b-9dd010a4156c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "cinder-quobyte-503f3dc4-0265-404f-9fa8-742f11ae8bef" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-503f3dc4-0265-404f-9fa8-742f11ae8bef" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "cinder-quobyte-1fbb5068-7bc3-4e36-993b-9dd010a4156c" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-1fbb5068-7bc3-4e36-993b-9dd010a4156c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Deleting offline snapshot 1fbb5068-7bc3-4e36-993b-9dd010a4156c of volume 503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] snapshot_file for this snap is: volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5949fd6-005c-44e3-b7f3-70b140cbd4a0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:52 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c Sep 07 09:59:52 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:53 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c" returned: 0 in 0.395s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-503f3dc4-0265-404f-9fa8-742f11ae8bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d2e67-778a-4721-9747-31daea3b22ff]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:53 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef Sep 07 09:59:53 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:53 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef" returned: 0 in 0.361s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:53 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c Sep 07 09:59:53 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:53 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:53 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c Sep 07 09:59:53 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:54 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef.1fbb5068-7bc3-4e36-993b-9dd010a4156c" returned: 0 in 0.239s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-1fbb5068-7bc3-4e36-993b-9dd010a4156c" released by "_delete_snapshot" :: held 1.426s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-503f3dc4-0265-404f-9fa8-742f11ae8bef" released by "delete_snapshot" :: held 1.449s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Created reservations ['806524dd-9257-4e70-8269-e4922b2a13a2', '8a294c93-2786-49e8-8370-0da131ef4cb6', '502ca33f-7294-4532-b57f-c9e59621424e', 'ad367d4a-a77b-4f35-b346-01cf375158df'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:54 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Delete snapshot completed successfully. Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da582b88-ef81-42d5-8d5a-5bb8a6452e52 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-1fbb5068-7bc3-4e36-993b-9dd010a4156c-delete_snapshot" released by "delete_snapshot" :: held 1.585s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "cinder-503f3dc4-0265-404f-9fa8-742f11ae8bef-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-503f3dc4-0265-404f-9fa8-742f11ae8bef-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "cinder-quobyte-503f3dc4-0265-404f-9fa8-742f11ae8bef" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-503f3dc4-0265-404f-9fa8-742f11ae8bef" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f43f7-1ac0-47d9-984b-66944c3d525b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:55 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef Sep 07 09:59:55 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:55 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef" returned: 0 in 0.388s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:55 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef Sep 07 09:59:55 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:55 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-503f3dc4-0265-404f-9fa8-742f11ae8bef" returned: 0 in 0.263s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-503f3dc4-0265-404f-9fa8-742f11ae8bef" released by "delete_volume" :: held 0.722s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Created reservations ['ac6be0bc-cc75-4283-b231-55979e902c9b', '4c735714-24a6-4610-815d-21ca2b1b1407', 'f17797ec-42f3-4e92-b6a1-908f85bd3f07', '0f8a8089-08de-48a3-9513-2c7ad7e6c6ad'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:55 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:55 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "cinder-74b489da-1d48-4773-a1da-b7ded16d01e0-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:56 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-74b489da-1d48-4773-a1da-b7ded16d01e0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Deleted volume successfully. Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8f4c29b6-4b36-4bac-9e67-764cb958e874 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-503f3dc4-0265-404f-9fa8-742f11ae8bef-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "cinder-quobyte-74b489da-1d48-4773-a1da-b7ded16d01e0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-74b489da-1d48-4773-a1da-b7ded16d01e0" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c20713-7858-417d-94a6-aba89d87481c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:56 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 Sep 07 09:59:56 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:56 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0" returned: 0 in 0.361s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:56 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0 Sep 07 09:59:56 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:56 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-74b489da-1d48-4773-a1da-b7ded16d01e0" returned: 0 in 0.257s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-quobyte-74b489da-1d48-4773-a1da-b7ded16d01e0" released by "delete_volume" :: held 0.656s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Created reservations ['0b90bcd8-ee4d-4307-ae35-efe19c3e67e8', '3b59d7a8-7844-4e2a-84ed-017f39724fe6', 'dddcb20b-d74b-4cc3-88e3-8f5f5f90e476', '4b1ae918-0a3b-4de1-b949-8cd7761bd60d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:56 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 09:59:56 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:57 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.266s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:57 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:57 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Deleted volume successfully. Sep 07 09:59:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9cdc27ea-e854-4f00-bb3e-64764be4c537 tempest-CinderUnicodeTest-283655236 None] Lock "cinder-74b489da-1d48-4773-a1da-b7ded16d01e0-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (986380d1-8b0f-41c6-b1b0-d5b66b065140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d2ca8a-92f1-45ec-a2f2-ce08f7b554f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d2ca8a-92f1-45ec-a2f2-ce08f7b554f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633465003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69716add-d0b2-43ea-b4ce-05737f1eca3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:00Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577d159b-92ac-4ca8-9514-17466af07ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577d159b-92ac-4ca8-9514-17466af07ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037508be-46b1-4844-b696-2b030f343002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037508be-46b1-4844-b696-2b030f343002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69716add-d0b2-43ea-b4ce-05737f1eca3e', 'volume_name': 'volume-69716add-d0b2-43ea-b4ce-05737f1eca3e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea20266-8ec1-4f30-98da-ee9cb43d2d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea20266-8ec1-4f30-98da-ee9cb43d2d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c41496-bd8f-41d1-9ee0-8f6a4acd0c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:00 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Volume 69716add-d0b2-43ea-b4ce-05737f1eca3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69716add-d0b2-43ea-b4ce-05737f1eca3e', 'volume_size': 1} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633465003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69716add-d0b2-43ea-b4ce-05737f1eca3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:00Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Creating volume 69716add-d0b2-43ea-b4ce-05737f1eca3e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:00 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:00 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e 1073741824 Sep 07 10:00:00 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:00 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e 1073741824" returned: 0 in 0.395s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:01 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e Sep 07 10:00:01 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:01 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e" returned: 0 in 0.245s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c41496-bd8f-41d1-9ee0-8f6a4acd0c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69716add-d0b2-43ea-b4ce-05737f1eca3e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf669cab-8de8-4679-8818-7743f696b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:01 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Volume volume-69716add-d0b2-43ea-b4ce-05737f1eca3e (69716add-d0b2-43ea-b4ce-05737f1eca3e): created successfully Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf669cab-8de8-4679-8818-7743f696b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (986380d1-8b0f-41c6-b1b0-d5b66b065140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:01 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-45a138d6-2468-4e72-ad14-30ea8c853a3c tempest-ProjectReaderTests-2103683046 None] Created volume successfully. Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-69716add-d0b2-43ea-b4ce-05737f1eca3e-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-69716add-d0b2-43ea-b4ce-05737f1eca3e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-quobyte-69716add-d0b2-43ea-b4ce-05737f1eca3e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-69716add-d0b2-43ea-b4ce-05737f1eca3e" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[93beffb5-80ad-4e0f-82cf-01ca1aac5edc]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:01 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e Sep 07 10:00:01 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:02 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e" returned: 0 in 0.393s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:02 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e Sep 07 10:00:02 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:02 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-69716add-d0b2-43ea-b4ce-05737f1eca3e" returned: 0 in 0.254s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-69716add-d0b2-43ea-b4ce-05737f1eca3e" released by "delete_volume" :: held 0.684s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Created reservations ['c042a318-6129-444f-8597-35022f2fcfb2', '66d1530a-0613-4236-b5a2-7adafeb5208b', '81b61db4-8dfc-45c5-9d95-9747695c2be7', 'acf6dbce-f4ea-44dd-bc24-65b19c976013'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:02 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:00:02 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:02 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Deleted volume successfully. Sep 07 10:00:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-80d7aafe-53cf-4c06-a761-535b6d677c84 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-69716add-d0b2-43ea-b4ce-05737f1eca3e-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (d94c709a-4cce-475b-bc9e-576582ed9b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ab18a0-c501-44ca-88cc-29eb216ad4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ab18a0-c501-44ca-88cc-29eb216ad4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965233006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9dfbac-dcb0-424f-832e-71709c6d96aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:03Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83683f3e-3ca1-4500-a24f-19208dc1176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83683f3e-3ca1-4500-a24f-19208dc1176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6bf652-db1a-4d61-88e8-f369da0d6370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6bf652-db1a-4d61-88e8-f369da0d6370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9dfbac-dcb0-424f-832e-71709c6d96aa', 'volume_name': 'volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5c8b72-4ea3-4b5f-b45f-02a66b9927cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5c8b72-4ea3-4b5f-b45f-02a66b9927cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadc2fde-22a5-4db0-b968-50dfbc1a72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Volume 5e9dfbac-dcb0-424f-832e-71709c6d96aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa', 'volume_size': 1} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965233006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9dfbac-dcb0-424f-832e-71709c6d96aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:03Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Creating volume 5e9dfbac-dcb0-424f-832e-71709c6d96aa {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:03 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:03 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa 1073741824 Sep 07 10:00:03 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:03 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa 1073741824" returned: 0 in 0.404s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:03 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa Sep 07 10:00:03 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:04 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa" returned: 0 in 0.244s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadc2fde-22a5-4db0-b968-50dfbc1a72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce251e3e-9db3-4e1c-a21c-7fd0bcabb393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:04 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Volume volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa (5e9dfbac-dcb0-424f-832e-71709c6d96aa): created successfully Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce251e3e-9db3-4e1c-a21c-7fd0bcabb393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (d94c709a-4cce-475b-bc9e-576582ed9b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-674fa2b3-2263-4221-9aa7-8a6eb9bb233f tempest-ProjectReaderTests-2103683046 None] Created volume successfully. Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-5e9dfbac-dcb0-424f-832e-71709c6d96aa-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Lock "cinder-5e9dfbac-dcb0-424f-832e-71709c6d96aa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-quobyte-5e9dfbac-dcb0-424f-832e-71709c6d96aa" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-5e9dfbac-dcb0-424f-832e-71709c6d96aa" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed716723-1bf4-4204-84ec-d2b58828619c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:04 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa Sep 07 10:00:04 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:04 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa" returned: 0 in 0.365s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:04 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa Sep 07 10:00:04 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:05 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5e9dfbac-dcb0-424f-832e-71709c6d96aa" returned: 0 in 0.255s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-5e9dfbac-dcb0-424f-832e-71709c6d96aa" released by "delete_volume" :: held 0.659s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Created reservations ['17ab2d9b-6546-4b3c-b4e9-fbceee66d9ad', '65dfb4ec-1556-4349-b275-060d60dac2ac', 'c344c39b-0947-4378-99d6-0e8c35dcc4b9', '127d611f-55a2-446b-a0d7-04cd70525276'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:05 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:00:05 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:05 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Deleted volume successfully. Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ec10c173-a715-4e2c-8791-731398f0de3b tempest-ProjectReaderTests-2103683046 None] Lock "cinder-5e9dfbac-dcb0-424f-832e-71709c6d96aa-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (ecb65e6e-b65e-4397-9720-803d66095235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ec0be-732c-4b10-888b-52834bf8f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ec0be-732c-4b10-888b-52834bf8f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466688887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:06Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afdf41a-9aab-484c-b42b-345a0c399ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afdf41a-9aab-484c-b42b-345a0c399ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a32f2c-a1bc-437a-9994-c8a72a69193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a32f2c-a1bc-437a-9994-c8a72a69193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9', 'volume_name': 'volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b013958-1bfb-45b7-8619-3afe4ecebfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b013958-1bfb-45b7-8619-3afe4ecebfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b89f0c-e97c-4e84-8b5d-111ec051c637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:06 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Volume 4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9', 'volume_size': 1} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466688887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:06Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Creating volume 4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:06 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:06 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 1073741824 Sep 07 10:00:06 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:06 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 1073741824" returned: 0 in 0.440s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:06 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 Sep 07 10:00:06 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:06 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9" returned: 0 in 0.252s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b89f0c-e97c-4e84-8b5d-111ec051c637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340de91b-7973-4d69-9416-6ba744e13114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:06 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Volume volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 (4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9): created successfully Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340de91b-7973-4d69-9416-6ba744e13114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (ecb65e6e-b65e-4397-9720-803d66095235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:06 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-009c3d31-bdfb-4cae-a604-e3be3ed4e565 tempest-ProjectReaderTests-2103683046 None] Created volume successfully. Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Lock "cinder-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-quobyte-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[af054b48-0cb8-4222-92e1-1e8a2880cb50]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:07 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 Sep 07 10:00:07 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:07 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9" returned: 0 in 0.375s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:07 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9 Sep 07 10:00:07 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:07 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9" returned: 0 in 0.250s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9" released by "delete_volume" :: held 0.661s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Created reservations ['6c6dde40-fcb5-45c5-a458-08da8f6ca9c8', 'd390183e-3496-403e-a5f7-13007c2f0769', '43df6e0e-9f0a-469b-b77b-9bd24e84479e', 'ced2ad13-0105-4dcf-89d2-563f7c397e71'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:07 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:00:07 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:08 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.279s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Deleted volume successfully. Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-38aa8a37-6926-4d65-8462-2862efbe9ace tempest-ProjectReaderTests-2103683046 None] Lock "cinder-4e8a7ee1-eea5-45d1-9dbf-9dd5fd1a9ea9-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (1d57435b-022e-4660-8977-9ec73defb0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c2a508-0970-445c-9787-2f3ca89169c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c2a508-0970-445c-9787-2f3ca89169c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060460369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70567307-1400-4158-9c37-6eb8f50e731e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:09Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ae086f-de41-417c-a5a4-380a285636a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ae086f-de41-417c-a5a4-380a285636a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaced64e-6e82-4080-afab-b86d30680817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaced64e-6e82-4080-afab-b86d30680817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70567307-1400-4158-9c37-6eb8f50e731e', 'volume_name': 'volume-70567307-1400-4158-9c37-6eb8f50e731e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519e2029-5fee-4bc6-803c-bd13027077e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519e2029-5fee-4bc6-803c-bd13027077e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2462e17d-d0d9-49d7-a8ac-c8c055e99862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Volume 70567307-1400-4158-9c37-6eb8f50e731e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70567307-1400-4158-9c37-6eb8f50e731e', 'volume_size': 1} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060460369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70567307-1400-4158-9c37-6eb8f50e731e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6c948e6c5444d3a3b7f27f3c11ede4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:09Z,use_quota=True,user_id='05842a55d69544cca973ac6681a18327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Creating volume 70567307-1400-4158-9c37-6eb8f50e731e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:08 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:00:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:08 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e 1073741824 Sep 07 10:00:08 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:09 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e 1073741824" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:09 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e Sep 07 10:00:09 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:09 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e" returned: 0 in 0.284s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2462e17d-d0d9-49d7-a8ac-c8c055e99862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70567307-1400-4158-9c37-6eb8f50e731e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d2b32e-bb67-4bcb-a372-d3f954e79a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Volume volume-70567307-1400-4158-9c37-6eb8f50e731e (70567307-1400-4158-9c37-6eb8f50e731e): created successfully Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d2b32e-bb67-4bcb-a372-d3f954e79a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Flow 'volume_create_manager' (1d57435b-022e-4660-8977-9ec73defb0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a72d441a-ca69-413c-9f36-1af7ce9e9c96 tempest-ProjectReaderTests-2103683046 None] Created volume successfully. Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-70567307-1400-4158-9c37-6eb8f50e731e-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-70567307-1400-4158-9c37-6eb8f50e731e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "cinder-quobyte-70567307-1400-4158-9c37-6eb8f50e731e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-70567307-1400-4158-9c37-6eb8f50e731e" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9940800-c5e7-4719-a3c5-8dfbdb3f0a13]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:09 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e Sep 07 10:00:09 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:10 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e" returned: 0 in 0.415s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:10 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e Sep 07 10:00:10 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:10 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70567307-1400-4158-9c37-6eb8f50e731e" returned: 0 in 0.291s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-quobyte-70567307-1400-4158-9c37-6eb8f50e731e" released by "delete_volume" :: held 0.755s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Created reservations ['ab0434bc-111b-48ce-bdb5-18adaf65ff09', '69bc25b8-d4f4-4e0b-b16b-29049210222b', '3b871b08-0856-4cfd-b4f6-dbfcffc22cb5', 'f3b08e02-0411-400c-ad16-354b5656d10b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:10 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:00:10 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:11 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.511s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:11 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Deleted volume successfully. Sep 07 10:00:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb9151af-f3f1-456d-8c8f-5d6ec99cc2a4 tempest-ProjectReaderTests-2103683046 None] Lock "cinder-70567307-1400-4158-9c37-6eb8f50e731e-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-2a075ea0-0692-4ec6-8023-9f379a8573ec tempest-TestShelveInstance-1541977130 None] Terminate volume connection completed successfully. Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-2a075ea0-0692-4ec6-8023-9f379a8573ec tempest-TestShelveInstance-1541977130 None] Deleting attachment 07fa7724-612f-4ff7-91a9-e2e8aa4d0784. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Acquiring lock "cinder-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Lock "cinder-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Acquiring lock "cinder-quobyte-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Lock "cinder-quobyte-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f00d6f-a963-4677-ba45-fe7afceebce7]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:12 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 Sep 07 10:00:12 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:12 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36" returned: 0 in 0.473s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:12 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36 Sep 07 10:00:12 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:13 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36" returned: 0 in 0.463s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Lock "cinder-quobyte-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36" released by "delete_volume" :: held 1.012s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG cinder.quota [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Created reservations ['e6a25cc9-bc45-4803-a36c-7cabf6494dc4', '99818712-d1fb-4fc4-8fe5-7669de932d66', 'a15f3180-b394-4079-908c-9f3d24fc7ee2', '1bb3fb97-be70-492e-9a6e-b5d3b7881c8b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:13 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:00:13 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:13 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.278s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG cinder.manager [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Deleted volume successfully. Sep 07 10:00:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [req-40c72626-c8a2-4a27-b052-d1bcb6f0e6dc req-3ae81389-6297-44e9-a3b9-6c5ba12859db tempest-TestShelveInstance-1541977130 None] Lock "cinder-10218c0e-2b02-4d19-b4f5-ed1d5fab5b36-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:23 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=87,cinder:UPDATE=109,cinder:DELETE=11,cinder:INSERT=25 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:00:23 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=90,cinder:INSERT=29,cinder:UPDATE=113,cinder:DELETE=8 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:41 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:00:41 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:41 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.302s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:00:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:00:45 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Flow 'volume_create_manager' (2e48ffc5-24cb-4c3a-aedc-74f0f5a52860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8365bb6-0bee-4525-a177-5b0bcf5777f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8365bb6-0bee-4525-a177-5b0bcf5777f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1498761568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ea4850-3a4a-4a96-9437-ff418ebcd2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42e9bb52abd4a8da6465387326612c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:46Z,use_quota=True,user_id='f8070b12622d4659b74b68dcfd780e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478dcc31-5d34-4e3e-8a85-59870aef33aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:45 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478dcc31-5d34-4e3e-8a85-59870aef33aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bcdebf-6a3a-49dc-a91f-e575af05aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bcdebf-6a3a-49dc-a91f-e575af05aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ea4850-3a4a-4a96-9437-ff418ebcd2f8', 'volume_name': 'volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e0c57f-6d2f-4e77-8084-3f897d86ef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e0c57f-6d2f-4e77-8084-3f897d86ef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ed685c-948b-41d0-b273-bfa7bda23e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:46 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Volume 26ea4850-3a4a-4a96-9437-ff418ebcd2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8', 'volume_size': 1} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1498761568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ea4850-3a4a-4a96-9437-ff418ebcd2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42e9bb52abd4a8da6465387326612c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:46Z,use_quota=True,user_id='f8070b12622d4659b74b68dcfd780e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Creating volume 26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:46 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:46 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 1073741824 Sep 07 10:00:46 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:46 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 1073741824" returned: 0 in 0.428s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:46 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 Sep 07 10:00:46 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:46 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ed685c-948b-41d0-b273-bfa7bda23e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2938ce-0e54-44e8-bd6f-bdd98428c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:46 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Volume volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 (26ea4850-3a4a-4a96-9437-ff418ebcd2f8): created successfully Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2938ce-0e54-44e8-bd6f-bdd98428c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:46 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Flow 'volume_create_manager' (2e48ffc5-24cb-4c3a-aedc-74f0f5a52860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-df457cf2-bbd6-49be-bfe3-9308bb1da1dd tempest-TestStampPattern-1662616360 None] Created volume successfully. Sep 07 10:00:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:00:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:01:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d31ccea2-fd54-41e9-bec8-c7a3c4207a38 req-20df7b72-62e0-4b8c-8641-febb33c6f822 tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d31ccea2-fd54-41e9-bec8-c7a3c4207a38 req-20df7b72-62e0-4b8c-8641-febb33c6f822 tempest-TestStampPattern-1662616360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-d31ccea2-fd54-41e9-bec8-c7a3c4207a38 req-20df7b72-62e0-4b8c-8641-febb33c6f822 tempest-TestStampPattern-1662616360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-d31ccea2-fd54-41e9-bec8-c7a3c4207a38 req-20df7b72-62e0-4b8c-8641-febb33c6f822 tempest-TestStampPattern-1662616360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b864f44a-3561-466a-8328-0f8b61e6a051', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:01:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-d31ccea2-fd54-41e9-bec8-c7a3c4207a38 req-20df7b72-62e0-4b8c-8641-febb33c6f822 tempest-TestStampPattern-1662616360 None] attachment_update completed successfully. Sep 07 10:01:19 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-9e7ba885-530c-420d-8725-5544c4230df1 req-3ebffeeb-a5ee-46d8-a667-a3951478fd14 tempest-TestStampPattern-1662616360 None] Terminate volume connection completed successfully. Sep 07 10:01:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-9e7ba885-530c-420d-8725-5544c4230df1 req-3ebffeeb-a5ee-46d8-a667-a3951478fd14 tempest-TestStampPattern-1662616360 None] Deleting attachment b864f44a-3561-466a-8328-0f8b61e6a051. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:01:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Creating offline snapshot 30e81007-de63-4016-8d2d-ca6386082849 of volume 26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:01:20 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc04b9a6-437f-4a1b-a777-4b6672c6e3c6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:20 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 Sep 07 10:01:20 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:20 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" returned: 0 in 0.364s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:21 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 1G Sep 07 10:01:21 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:21 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 1G" returned: 0 in 0.404s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:21 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 Sep 07 10:01:21 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:21 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849" returned: 0 in 0.300s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:21 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 is being set with open permissions: ugo+rw Sep 07 10:01:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:21 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 Sep 07 10:01:21 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:21 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849" returned: 0 in 0.252s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:22 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.info Sep 07 10:01:22 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:22 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.info" returned: 0 in 0.262s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:22 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.info is being set with open permissions: ugo+rw Sep 07 10:01:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:22 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.info Sep 07 10:01:22 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:22 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.info" returned: 0 in 0.249s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:22 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a5b007db-85f8-4813-9b6d-9bad2e89fdfb tempest-TestStampPattern-1662616360 None] Create snapshot completed successfully Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Flow 'volume_create_manager' (be5e10ac-e5a8-4413-a242-eebedce85912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa291994-eaa1-42ab-aecb-2b41350c0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa291994-eaa1-42ab-aecb-2b41350c0653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1237903136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5481346-459f-456b-8e21-39342c9dcef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42e9bb52abd4a8da6465387326612c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30e81007-de63-4016-8d2d-ca6386082849,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:01:29Z,use_quota=True,user_id='f8070b12622d4659b74b68dcfd780e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15882364-eb6e-4d32-8a5a-4c2787c7d4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15882364-eb6e-4d32-8a5a-4c2787c7d4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e59a3e-55c7-471f-9c47-ec3ff5fec278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e59a3e-55c7-471f-9c47-ec3ff5fec278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5481346-459f-456b-8e21-39342c9dcef6', 'volume_name': 'volume-c5481346-459f-456b-8e21-39342c9dcef6', 'volume_size': 1, 'snapshot_id': '30e81007-de63-4016-8d2d-ca6386082849'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cd05cd-0dc2-452f-9c57-bee086cb3f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cd05cd-0dc2-452f-9c57-bee086cb3f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8789bc33-e61b-4f65-9b91-369421e6a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:29 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Volume c5481346-459f-456b-8e21-39342c9dcef6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5481346-459f-456b-8e21-39342c9dcef6', 'volume_size': 1, 'snapshot_id': '30e81007-de63-4016-8d2d-ca6386082849'} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-quobyte-30e81007-de63-4016-8d2d-ca6386082849-c5481346-459f-456b-8e21-39342c9dcef6" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-30e81007-de63-4016-8d2d-ca6386082849-c5481346-459f-456b-8e21-39342c9dcef6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Creating volume c5481346-459f-456b-8e21-39342c9dcef6 from snapshot 30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-quobyte-c5481346-459f-456b-8e21-39342c9dcef6" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-c5481346-459f-456b-8e21-39342c9dcef6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] snapshot: 30e81007-de63-4016-8d2d-ca6386082849, volume: c5481346-459f-456b-8e21-39342c9dcef6, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[030c3af6-fa3a-45c9-953a-aa8cca9f1340]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:29 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 Sep 07 10:01:29 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:29 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849" returned: 0 in 0.375s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f335d473-ec1d-481d-b177-86846bf8b996]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:30 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 Sep 07 10:01:30 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:30 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" returned: 0 in 0.450s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:01:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:01:30 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:01:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:30 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 Sep 07 10:01:30 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:36 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6" returned: 0 in 5.622s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:01:36 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Converted 1024.00 MB image at 182.07 MB/s Sep 07 10:01:36 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 is being set with open permissions: ugo+rw Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:36 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 Sep 07 10:01:36 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:36 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6" returned: 0 in 0.310s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-c5481346-459f-456b-8e21-39342c9dcef6" released by "_copy_volume_from_snapshot" :: held 6.841s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-30e81007-de63-4016-8d2d-ca6386082849-c5481346-459f-456b-8e21-39342c9dcef6" released by "_create_volume_from_snapshot" :: held 6.929s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.944s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8789bc33-e61b-4f65-9b91-369421e6a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5481346-459f-456b-8e21-39342c9dcef6', 'volume_size': 1, 'snapshot_id': '30e81007-de63-4016-8d2d-ca6386082849'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8c4d94-f616-446b-8228-3e86d7df0a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Volume volume-c5481346-459f-456b-8e21-39342c9dcef6 (c5481346-459f-456b-8e21-39342c9dcef6): created successfully Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8c4d94-f616-446b-8228-3e86d7df0a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Flow 'volume_create_manager' (be5e10ac-e5a8-4413-a242-eebedce85912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:01:36 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-31bc179b-82ea-42cb-8f09-5432cf133c7d tempest-TestStampPattern-1662616360 None] Created volume successfully. Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:41 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:01:41 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:41 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:01:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:01:46 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:01:46 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:02:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-cba717cc-44c3-4b8e-99d2-d2dcb09952f8 req-c4a7a93d-cc4a-40a7-b9eb-c3f06caceba4 tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-cba717cc-44c3-4b8e-99d2-d2dcb09952f8 req-c4a7a93d-cc4a-40a7-b9eb-c3f06caceba4 tempest-TestStampPattern-1662616360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [req-cba717cc-44c3-4b8e-99d2-d2dcb09952f8 req-c4a7a93d-cc4a-40a7-b9eb-c3f06caceba4 tempest-TestStampPattern-1662616360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:19 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-cba717cc-44c3-4b8e-99d2-d2dcb09952f8 req-c4a7a93d-cc4a-40a7-b9eb-c3f06caceba4 tempest-TestStampPattern-1662616360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4', 'name': 'volume-c5481346-459f-456b-8e21-39342c9dcef6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c628e06-ceeb-48ac-95bb-d6065d5008e1', 'enforce_multipath': True} {{(pid=87290) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:02:19 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-cba717cc-44c3-4b8e-99d2-d2dcb09952f8 req-c4a7a93d-cc4a-40a7-b9eb-c3f06caceba4 tempest-TestStampPattern-1662616360 None] attachment_update completed successfully. Sep 07 10:02:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [req-62150564-114b-46d3-8754-abca2d71e98a req-81b8a220-378d-41a7-9296-79f1030b3866 tempest-TestStampPattern-1662616360 None] Terminate volume connection completed successfully. Sep 07 10:02:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [req-62150564-114b-46d3-8754-abca2d71e98a req-81b8a220-378d-41a7-9296-79f1030b3866 tempest-TestStampPattern-1662616360 None] Deleting attachment 2c628e06-ceeb-48ac-95bb-d6065d5008e1. {{(pid=87290) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:02:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-c5481346-459f-456b-8e21-39342c9dcef6-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Lock "cinder-c5481346-459f-456b-8e21-39342c9dcef6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-quobyte-c5481346-459f-456b-8e21-39342c9dcef6" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-c5481346-459f-456b-8e21-39342c9dcef6" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4052596-e766-4b81-9af0-65bedf645666]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:25 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 Sep 07 10:02:25 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:26 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6" returned: 0 in 0.336s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:26 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6 Sep 07 10:02:26 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:26 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c5481346-459f-456b-8e21-39342c9dcef6" returned: 0 in 0.246s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-c5481346-459f-456b-8e21-39342c9dcef6" released by "delete_volume" :: held 0.617s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Created reservations ['9fae26df-e899-4d06-ba00-7ec659df2cb0', '637f119e-120e-4524-989f-91e6ff13f0b1', 'd43a27ee-7f52-4117-b9b4-fe04438c018d', '37196ea5-f743-4eff-91bc-4090a247b93b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:26 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:02:26 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:26 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.237s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Deleted volume successfully. Sep 07 10:02:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-992878ca-4675-4d21-afdf-259996faee03 tempest-TestStampPattern-1662616360 None] Lock "cinder-c5481346-459f-456b-8e21-39342c9dcef6-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-30e81007-de63-4016-8d2d-ca6386082849-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Lock "cinder-30e81007-de63-4016-8d2d-ca6386082849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-quobyte-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-quobyte-30e81007-de63-4016-8d2d-ca6386082849" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-30e81007-de63-4016-8d2d-ca6386082849" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Deleting offline snapshot 30e81007-de63-4016-8d2d-ca6386082849 of volume 26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] snapshot_file for this snap is: volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c58f0-197e-48bc-9f0c-9b790d81d3d7]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:27 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 Sep 07 10:02:27 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:27 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[39be6034-58ed-4d51-8791-45bf7756edfb]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:27 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 Sep 07 10:02:27 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:27 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" returned: 0 in 0.502s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:28 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 Sep 07 10:02:28 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:28 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849" returned: 0 in 0.308s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:28 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849 Sep 07 10:02:28 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:28 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8.30e81007-de63-4016-8d2d-ca6386082849" returned: 0 in 0.234s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-30e81007-de63-4016-8d2d-ca6386082849" released by "_delete_snapshot" :: held 1.478s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" released by "delete_snapshot" :: held 1.498s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:28 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Created reservations ['aba37637-2922-4c66-a5bd-8e9c48253493', 'dc428b11-19f6-4696-91b0-0883763c2444', 'c3da4343-47df-42b0-8af3-06af374c6ca7', 'a3aa0294-bc44-41e7-b75e-5952c7eb4cd3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Delete snapshot completed successfully. Sep 07 10:02:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-56590df7-ca4e-4e7f-9ce5-fd4a4b821137 tempest-TestStampPattern-1662616360 None] Lock "cinder-30e81007-de63-4016-8d2d-ca6386082849-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-26ea4850-3a4a-4a96-9437-ff418ebcd2f8-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Lock "cinder-26ea4850-3a4a-4a96-9437-ff418ebcd2f8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Acquiring lock "cinder-quobyte-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:32 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace503b1-1d99-4e10-8454-e6cf35b13b52]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:32 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 Sep 07 10:02:32 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:33 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" returned: 0 in 0.341s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:33 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8 Sep 07 10:02:33 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:33 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" returned: 0 in 0.244s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Lock "cinder-quobyte-26ea4850-3a4a-4a96-9437-ff418ebcd2f8" released by "delete_volume" :: held 0.636s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Created reservations ['d31d5fc4-c564-40eb-8f68-26d7f6e0d23a', '1a1015a7-7c99-46ae-8ade-38273a392857', '6808c5b2-9c8b-4b2b-accf-0778ba86c8f1', 'aa1698fd-4053-4419-b5bd-bf9f5e6a1878'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:33 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:02:33 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:33 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.232s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:33 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Deleted volume successfully. Sep 07 10:02:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-fb21e190-6274-4e2c-afdd-a9c2dfa6935d tempest-TestStampPattern-1662616360 None] Lock "cinder-26ea4850-3a4a-4a96-9437-ff418ebcd2f8-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:41 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:02:41 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:41 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.249s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:02:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:02:43 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:02:43 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Flow 'volume_create_manager' (05467d18-a8ca-49cf-986b-25d0c9628ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30148fc7-de14-432e-bee2-117bbdd1fa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30148fc7-de14-432e-bee2-117bbdd1fa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e7fe4e-97d8-490e-85ee-f0d58b8d1d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea750201496a47a99988d475033713e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:48Z,use_quota=True,user_id='643f22c4f67b4a419f035427055cafa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18e257c7-be81-4f99-bbb9-b5f1b0387a3b),volume_type_id=18e257c7-be81-4f99-bbb9-b5f1b0387a3b)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0400a4be-217b-4c18-a419-29299f1051d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0400a4be-217b-4c18-a419-29299f1051d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3c5564-98bb-4ee5-994f-c5f59b69509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:47 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3c5564-98bb-4ee5-994f-c5f59b69509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16e7fe4e-97d8-490e-85ee-f0d58b8d1d66', 'volume_name': 'volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66', 'volume_size': 1, 'image_id': '7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51fa0df7b13654fadf76751f59a0d411', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea750201496a47a99988d475033713e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab62e313bb6fa9b48d6492e0f6b2643f4fb2b88dc06da4741e1571f851b300d01ffcccad9be56064bf0213868d2f9f1e2a0e35504e3eeb2bd3b1a45a364a0b0b', 'id': '7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'created_at': datetime.datetime(2026, 9, 7, 8, 2, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 2, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310c22f1-2a99-4628-a6e7-48cef4420e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310c22f1-2a99-4628-a6e7-48cef4420e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e987f0f2-5ea6-4ff4-909c-587cae22b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:48 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Volume 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66', 'volume_size': 1, 'image_id': '7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51fa0df7b13654fadf76751f59a0d411', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea750201496a47a99988d475033713e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab62e313bb6fa9b48d6492e0f6b2643f4fb2b88dc06da4741e1571f851b300d01ffcccad9be56064bf0213868d2f9f1e2a0e35504e3eeb2bd3b1a45a364a0b0b', 'id': '7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'created_at': datetime.datetime(2026, 9, 7, 8, 2, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 2, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Trying to clone 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 from image 7ee21fe2-aac2-4dbd-891d-d6435e57c106 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:02:48 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Image download 0.00 MB at 0.00 MB/s Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87bf854-71a8-4775-9602-92060b969845]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:48 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD Sep 07 10:02:48 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:48 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:48 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD Sep 07 10:02:48 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:48 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Temporary image 7ee21fe2-aac2-4dbd-891d-d6435e57c106 is fetched for user 643f22c4f67b4a419f035427055cafa4. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263df98-5098-46d3-bd96-6cef1971e06f]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:48 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD Sep 07 10:02:48 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:49 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD" returned: 0 in 0.311s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:49 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD Sep 07 10:02:49 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:49 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD" returned: 1 in 0.307s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e7fe4e-97d8-490e-85ee-f0d58b8d1d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea750201496a47a99988d475033713e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:48Z,use_quota=True,user_id='643f22c4f67b4a419f035427055cafa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18e257c7-be81-4f99-bbb9-b5f1b0387a3b),volume_type_id=18e257c7-be81-4f99-bbb9-b5f1b0387a3b)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Creating volume 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:49 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:49 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 1073741824 Sep 07 10:02:49 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:49 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 1073741824" returned: 0 in 0.391s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:49 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 Sep 07 10:02:49 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:50 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66" returned: 0 in 0.233s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Attempting download of 7ee21fe2-aac2-4dbd-891d-d6435e57c106 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'metadata': {}}])) to volume 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b5af98-acbf-44b1-a17b-15e66d6a82ac]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ee21fe2-aac2-4dbd-891d-d6435e57c106_5_xot1f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:50 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ee21fe2-aac2-4dbd-891d-d6435e57c106_5_xot1f8 Sep 07 10:02:50 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:50 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ee21fe2-aac2-4dbd-891d-d6435e57c106_5_xot1f8" returned: 0 in 0.314s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ee21fe2-aac2-4dbd-891d-d6435e57c106_5_xot1f8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:50 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ee21fe2-aac2-4dbd-891d-d6435e57c106_5_xot1f8 Sep 07 10:02:50 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:50 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ee21fe2-aac2-4dbd-891d-d6435e57c106_5_xot1f8" returned: 1 in 0.324s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ee21fe2-aac2-4dbd-891d-d6435e57c106_5_xot1f8' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0249a727-9489-4798-aede-24703088479e]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:50 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD Sep 07 10:02:50 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:51 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:51 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD Sep 07 10:02:51 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:51 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD" returned: 1 in 0.305s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] 7ee21fe2-aac2-4dbd-891d-d6435e57c106 was raw, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:51 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 Sep 07 10:02:51 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:51 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66" returned: 0 in 0.401s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ee21fe2-aac2-4dbd-891d-d6435e57c106_s_liqm62devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:02:51 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 10:02:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:51 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 1G Sep 07 10:02:51 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:52 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 1G" returned: 0 in 0.296s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Downloaded image 7ee21fe2-aac2-4dbd-891d-d6435e57c106 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'metadata': {}}])) to volume 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Temporary image 7ee21fe2-aac2-4dbd-891d-d6435e57c106 for user 643f22c4f67b4a419f035427055cafa4 is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Marking volume 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Copying metadata from image 7ee21fe2-aac2-4dbd-891d-d6435e57c106 to 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Creating volume glance metadata for volume 16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 backed by image 7ee21fe2-aac2-4dbd-891d-d6435e57c106 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '51fa0df7b13654fadf76751f59a0d411', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e987f0f2-5ea6-4ff4-909c-587cae22b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66', 'volume_size': 1, 'image_id': '7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51fa0df7b13654fadf76751f59a0d411', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea750201496a47a99988d475033713e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab62e313bb6fa9b48d6492e0f6b2643f4fb2b88dc06da4741e1571f851b300d01ffcccad9be56064bf0213868d2f9f1e2a0e35504e3eeb2bd3b1a45a364a0b0b', 'id': '7ee21fe2-aac2-4dbd-891d-d6435e57c106', 'created_at': datetime.datetime(2026, 9, 7, 8, 2, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 2, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ee21fe2-aac2-4dbd-891d-d6435e57c106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f7c406-6cd2-4875-a9f6-d3457d7339b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:52 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Volume volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 (16e7fe4e-97d8-490e-85ee-f0d58b8d1d66): created successfully Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f7c406-6cd2-4875-a9f6-d3457d7339b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:52 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Flow 'volume_create_manager' (05467d18-a8ca-49cf-986b-25d0c9628ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:52 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ae140bf3-de61-4d81-b517-69f7a4c3396d tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Created volume successfully. Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Acquiring lock "cinder-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "cinder-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Acquiring lock "cinder-quobyte-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "cinder-quobyte-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[29213351-4d8c-4274-9d82-a9e896daea05]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:53 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 Sep 07 10:02:53 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:53 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66" returned: 0 in 0.342s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:53 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66 Sep 07 10:02:53 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:53 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66" returned: 0 in 0.237s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "cinder-quobyte-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66" released by "delete_volume" :: held 0.619s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:53 devstack cinder-volume[87290]: WARNING cinder.quota [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:02:53 devstack cinder-volume[87290]: WARNING cinder.quota [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Created reservations ['037fc235-cb55-4902-ad0c-362fdc69a08c', '414f2d7f-c95b-48de-a17b-c5b0a7bd48a2', '7f6fe8dd-91ff-430c-943c-9ecf1ed496d6', 'e3bad0be-0ab3-4732-a48c-a3cfdb0f0fad'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:53 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:53 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:02:53 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:54 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.231s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:54 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:54 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Deleted volume successfully. Sep 07 10:02:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8c1c5d56-7098-44a9-acf9-92d9a9ba909e tempest-VolumeAndVolumeTypeFromImageTest-1936357364 None] Lock "cinder-16e7fe4e-97d8-490e-85ee-f0d58b8d1d66-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Flow 'volume_create_manager' (e2d15a56-e3e5-4e71-890d-17f01955c04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6eb959-043b-4082-aee0-f922778a07e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6eb959-043b-4082-aee0-f922778a07e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592296035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468e5807-a0b5-414b-b21d-e6c280cc7330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd6b655a86449781c2aaf6c5a2e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:59Z,use_quota=True,user_id='66ea1d6bc1334ba2a2a993ac2128a16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86634bb9-6319-41ef-b936-12576eb400a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86634bb9-6319-41ef-b936-12576eb400a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b82ae4-203d-4b64-8d96-36ba8678d82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b82ae4-203d-4b64-8d96-36ba8678d82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468e5807-a0b5-414b-b21d-e6c280cc7330', 'volume_name': 'volume-468e5807-a0b5-414b-b21d-e6c280cc7330', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b15c2ac-2b67-499d-8e7d-7d8bd29185d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b15c2ac-2b67-499d-8e7d-7d8bd29185d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ccb2fb-c8a2-426d-af10-64ae5dbbe04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:58 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Volume 468e5807-a0b5-414b-b21d-e6c280cc7330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468e5807-a0b5-414b-b21d-e6c280cc7330', 'volume_size': 1} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592296035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468e5807-a0b5-414b-b21d-e6c280cc7330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd6b655a86449781c2aaf6c5a2e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:59Z,use_quota=True,user_id='66ea1d6bc1334ba2a2a993ac2128a16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Creating volume 468e5807-a0b5-414b-b21d-e6c280cc7330 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:58 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:02:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:58 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 1073741824 Sep 07 10:02:58 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:59 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 1073741824" returned: 0 in 0.399s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:59 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 Sep 07 10:02:59 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:59 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330" returned: 0 in 0.229s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ccb2fb-c8a2-426d-af10-64ae5dbbe04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468e5807-a0b5-414b-b21d-e6c280cc7330', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa9f0b8-5bf9-4bca-9a69-70489a6d17b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:59 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Volume volume-468e5807-a0b5-414b-b21d-e6c280cc7330 (468e5807-a0b5-414b-b21d-e6c280cc7330): created successfully Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa9f0b8-5bf9-4bca-9a69-70489a6d17b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Flow 'volume_create_manager' (e2d15a56-e3e5-4e71-890d-17f01955c04d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0b08c7ae-2706-4a0a-b31a-081d3bca1396 tempest-ProjectReaderTests-2044200290 None] Created volume successfully. Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "cinder-468e5807-a0b5-414b-b21d-e6c280cc7330-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-468e5807-a0b5-414b-b21d-e6c280cc7330-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "cinder-quobyte-468e5807-a0b5-414b-b21d-e6c280cc7330" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-quobyte-468e5807-a0b5-414b-b21d-e6c280cc7330" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2ec809-c33e-4f75-9613-73c4213e359d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:59 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 Sep 07 10:02:59 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:00 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330" returned: 0 in 0.349s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:00 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330 Sep 07 10:03:00 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:00 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-468e5807-a0b5-414b-b21d-e6c280cc7330" returned: 0 in 0.229s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-quobyte-468e5807-a0b5-414b-b21d-e6c280cc7330" released by "delete_volume" :: held 0.613s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Created reservations ['230d9c30-3eee-45ca-983e-35ffadff7c05', 'ff3c7081-686f-4fb8-90dd-c75d09377b8c', '285eea86-e6e4-4302-9f97-98f38d5a4edd', '7bb827e8-f556-43c6-a9b5-3403da645dc2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:00 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:03:00 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:00 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.230s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:00 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Deleted volume successfully. Sep 07 10:03:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5a515770-6d29-4b6b-b11d-dc6894a1d9d0 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-468e5807-a0b5-414b-b21d-e6c280cc7330-delete_volume" released by "delete_volume" :: held 1.015s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Flow 'volume_create_manager' (65ae91d0-e0d3-4742-9e0d-6297ecdae365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282db127-a9fd-4e54-be0b-e68ede757eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282db127-a9fd-4e54-be0b-e68ede757eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466575519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3302a946-4fe4-4bf1-9f13-25e04835f802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd6b655a86449781c2aaf6c5a2e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:01Z,use_quota=True,user_id='66ea1d6bc1334ba2a2a993ac2128a16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc3e714-083a-46c6-a29d-74644138664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc3e714-083a-46c6-a29d-74644138664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf9280-8360-474c-b340-81f150a440a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf9280-8360-474c-b340-81f150a440a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3302a946-4fe4-4bf1-9f13-25e04835f802', 'volume_name': 'volume-3302a946-4fe4-4bf1-9f13-25e04835f802', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bbded1-7f7e-45c2-ab24-4c641acacd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bbded1-7f7e-45c2-ab24-4c641acacd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15cc6d7-932d-4622-a5ff-f7027cc40af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Volume 3302a946-4fe4-4bf1-9f13-25e04835f802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3302a946-4fe4-4bf1-9f13-25e04835f802', 'volume_size': 1} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466575519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3302a946-4fe4-4bf1-9f13-25e04835f802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dd6b655a86449781c2aaf6c5a2e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:01Z,use_quota=True,user_id='66ea1d6bc1334ba2a2a993ac2128a16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Creating volume 3302a946-4fe4-4bf1-9f13-25e04835f802 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:01 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:01 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 1073741824 Sep 07 10:03:01 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:01 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 1073741824" returned: 0 in 0.443s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:01 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 Sep 07 10:03:01 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:02 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802" returned: 0 in 0.264s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15cc6d7-932d-4622-a5ff-f7027cc40af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3302a946-4fe4-4bf1-9f13-25e04835f802', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a662ce19-a74b-4d17-8b7d-c2438b43b235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:02 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Volume volume-3302a946-4fe4-4bf1-9f13-25e04835f802 (3302a946-4fe4-4bf1-9f13-25e04835f802): created successfully Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a662ce19-a74b-4d17-8b7d-c2438b43b235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Flow 'volume_create_manager' (65ae91d0-e0d3-4742-9e0d-6297ecdae365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e09386be-1899-4f67-bf08-477122e1f91d tempest-ProjectReaderTests-2044200290 None] Created volume successfully. Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "cinder-3302a946-4fe4-4bf1-9f13-25e04835f802-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-3302a946-4fe4-4bf1-9f13-25e04835f802-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "cinder-quobyte-3302a946-4fe4-4bf1-9f13-25e04835f802" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-quobyte-3302a946-4fe4-4bf1-9f13-25e04835f802" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a416b24-ccd5-406d-8399-d697f8d53e9a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:02 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 Sep 07 10:03:02 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:02 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802" returned: 0 in 0.366s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:02 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802 Sep 07 10:03:02 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:03 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3302a946-4fe4-4bf1-9f13-25e04835f802" returned: 0 in 0.237s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-quobyte-3302a946-4fe4-4bf1-9f13-25e04835f802" released by "delete_volume" :: held 0.637s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Created reservations ['a9ac2b08-39a6-4eb3-b764-fdfed3e5df69', 'ddde711d-509a-466a-bfaf-796d1cc33422', '7ed65b13-2f1c-4240-b522-a1867e4f67d1', 'd7be6026-0c0a-4a31-82f9-2aa7d237ffa9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:03 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:03:03 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:03 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.231s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Deleted volume successfully. Sep 07 10:03:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-31864522-7a3b-4b28-bbc9-b74cb65f4944 tempest-ProjectReaderTests-2044200290 None] Lock "cinder-3302a946-4fe4-4bf1-9f13-25e04835f802-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:13 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=30,cinder:INSERT=15,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:03:13 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=34,cinder:SELECT=25,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Flow 'volume_create_manager' (6e24b3ec-974a-4ff8-99d9-86de204a367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8019d9-e405-409c-aaf2-ec7af9829205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8019d9-e405-409c-aaf2-ec7af9829205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-221805924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83cae3b-be2e-4714-8351-ca2ff6bd8f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ab3bb50d143ef9a8a101fc9b77f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:33Z,use_quota=True,user_id='c81007fcc9524150b3aaee7a79fd3f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee00dc7c-3b49-43ba-bbbe-83880d840165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee00dc7c-3b49-43ba-bbbe-83880d840165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc1738c-419e-41c4-b75c-90c81493bcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc1738c-419e-41c4-b75c-90c81493bcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83cae3b-be2e-4714-8351-ca2ff6bd8f75', 'volume_name': 'volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e605a3ed-3ad4-4519-8b04-bb81989c1392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e605a3ed-3ad4-4519-8b04-bb81989c1392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0551e4-34c5-43b7-9fff-15773f2bf7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Volume c83cae3b-be2e-4714-8351-ca2ff6bd8f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75', 'volume_size': 1} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-221805924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83cae3b-be2e-4714-8351-ca2ff6bd8f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ab3bb50d143ef9a8a101fc9b77f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:33Z,use_quota=True,user_id='c81007fcc9524150b3aaee7a79fd3f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Creating volume c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:32 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:03:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:32 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 1073741824 Sep 07 10:03:32 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:33 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 1073741824" returned: 0 in 0.434s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:33 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 Sep 07 10:03:33 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:33 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0551e4-34c5-43b7-9fff-15773f2bf7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165392da-145b-4cf8-b91a-da8771deb710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:33 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Volume volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 (c83cae3b-be2e-4714-8351-ca2ff6bd8f75): created successfully Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165392da-145b-4cf8-b91a-da8771deb710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Flow 'volume_create_manager' (6e24b3ec-974a-4ff8-99d9-86de204a367f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:33 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bbd4f65c-be26-485b-880c-3be99f75c9f1 tempest-SnapshotDependencyTests-628970785 None] Created volume successfully. Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Creating offline snapshot 4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 of volume c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7629f043-d695-4d16-868a-87242ceeed37]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:34 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 Sep 07 10:03:34 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:34 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" returned: 0 in 0.374s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:34 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 1G Sep 07 10:03:34 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:34 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 1G" returned: 0 in 0.400s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:34 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 Sep 07 10:03:34 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:35 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" returned: 0 in 0.315s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:35 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 is being set with open permissions: ugo+rw Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:35 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 Sep 07 10:03:35 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:35 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" returned: 0 in 0.255s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:35 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.info Sep 07 10:03:35 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:35 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.info" returned: 0 in 0.260s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:35 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.info is being set with open permissions: ugo+rw Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:35 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.info Sep 07 10:03:35 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:35 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.info" returned: 0 in 0.249s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:36 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-7685b390-0f49-434b-bfa2-4b3bf9dddffb tempest-SnapshotDependencyTests-628970785 None] Create snapshot completed successfully Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Flow 'volume_create_manager' (17a2dee9-4333-4db4-b982-b668a8e34227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7315a512-5c63-44ab-ab3b-005554949aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7315a512-5c63-44ab-ab3b-005554949aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167432bb-7a62-472f-aaca-ae079d0cb4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99ab3bb50d143ef9a8a101fc9b77f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4d2b8773-a01e-4c20-86d1-4d29b9c71ca9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:37Z,use_quota=True,user_id='c81007fcc9524150b3aaee7a79fd3f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f41018-17b0-4af2-a60d-9b76329e77ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f41018-17b0-4af2-a60d-9b76329e77ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb17a35-545e-4ba0-900c-c5529df5f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb17a35-545e-4ba0-900c-c5529df5f065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '167432bb-7a62-472f-aaca-ae079d0cb4bb', 'volume_name': 'volume-167432bb-7a62-472f-aaca-ae079d0cb4bb', 'volume_size': 1, 'snapshot_id': '4d2b8773-a01e-4c20-86d1-4d29b9c71ca9'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ed47f8-81cc-4c51-ac82-ac470a8aa858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ed47f8-81cc-4c51-ac82-ac470a8aa858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff58fa1-45a2-4669-ad6b-f7e26c02d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Volume 167432bb-7a62-472f-aaca-ae079d0cb4bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-167432bb-7a62-472f-aaca-ae079d0cb4bb', 'volume_size': 1, 'snapshot_id': '4d2b8773-a01e-4c20-86d1-4d29b9c71ca9'} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-quobyte-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9-167432bb-7a62-472f-aaca-ae079d0cb4bb" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9-167432bb-7a62-472f-aaca-ae079d0cb4bb" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Creating volume 167432bb-7a62-472f-aaca-ae079d0cb4bb from snapshot 4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-quobyte-167432bb-7a62-472f-aaca-ae079d0cb4bb" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-167432bb-7a62-472f-aaca-ae079d0cb4bb" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] snapshot: 4d2b8773-a01e-4c20-86d1-4d29b9c71ca9, volume: 167432bb-7a62-472f-aaca-ae079d0cb4bb, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade28c43-5272-468f-a4d2-d1da02e9e93a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:37 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 Sep 07 10:03:37 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:37 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" returned: 0 in 0.379s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c8e3ad-e4fb-4982-bbb8-dfc6de112986]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:37 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 Sep 07 10:03:37 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:37 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" returned: 0 in 0.367s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:03:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:37 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb Sep 07 10:03:37 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:41 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:03:41 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:41 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.366s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:03:41 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb" returned: 0 in 4.116s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:03:41 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Converted 1024.00 MB image at 248.76 MB/s Sep 07 10:03:41 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb is being set with open permissions: ugo+rw Sep 07 10:03:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:41 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb Sep 07 10:03:41 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:42 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb" returned: 0 in 0.250s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-167432bb-7a62-472f-aaca-ae079d0cb4bb" released by "_copy_volume_from_snapshot" :: held 5.185s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9-167432bb-7a62-472f-aaca-ae079d0cb4bb" released by "_create_volume_from_snapshot" :: held 5.249s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.265s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff58fa1-45a2-4669-ad6b-f7e26c02d212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167432bb-7a62-472f-aaca-ae079d0cb4bb', 'volume_size': 1, 'snapshot_id': '4d2b8773-a01e-4c20-86d1-4d29b9c71ca9'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d45a87b-8e01-44e7-8c81-c52888821d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:42 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Volume volume-167432bb-7a62-472f-aaca-ae079d0cb4bb (167432bb-7a62-472f-aaca-ae079d0cb4bb): created successfully Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d45a87b-8e01-44e7-8c81-c52888821d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:42 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Flow 'volume_create_manager' (17a2dee9-4333-4db4-b982-b668a8e34227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9dbd969d-2930-4ff1-bcb2-5cd1cee3b6a4 tempest-SnapshotDependencyTests-628970785 None] Created volume successfully. Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-quobyte-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-quobyte-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Deleting offline snapshot 4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 of volume c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] snapshot_file for this snap is: volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb15de7-f22d-417a-8518-329ba693afb3]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:43 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 Sep 07 10:03:43 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:43 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" returned: 0 in 0.345s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[faba3d30-aa48-482e-8012-2d83f95d3eff]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:43 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 Sep 07 10:03:43 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:44 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" returned: 0 in 0.524s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:44 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 Sep 07 10:03:44 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:44 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" returned: 0 in 0.311s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:44 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9 Sep 07 10:03:44 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:44 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75.4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" returned: 0 in 0.241s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9" released by "_delete_snapshot" :: held 1.515s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" released by "delete_snapshot" :: held 1.538s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:44 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Created reservations ['179da0d7-d044-4731-bf7c-596d73632799', 'd5b0fbc6-2591-46c5-bd23-c261fb8b8a8d', 'a6703836-8898-4756-b556-357530a89cea', 'f08fcc79-d0f7-41d5-b81a-aa12113113b7'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:45 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Delete snapshot completed successfully. Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-635dba06-d605-4e21-b1c8-c1616ab4da85 tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-4d2b8773-a01e-4c20-86d1-4d29b9c71ca9-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-c83cae3b-be2e-4714-8351-ca2ff6bd8f75-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-c83cae3b-be2e-4714-8351-ca2ff6bd8f75-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-quobyte-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2f4190-25ac-4ed8-8947-96bb7a024b6a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:45 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 Sep 07 10:03:45 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:45 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" returned: 0 in 0.349s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:45 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75 Sep 07 10:03:45 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:46 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" returned: 0 in 0.236s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-c83cae3b-be2e-4714-8351-ca2ff6bd8f75" released by "delete_volume" :: held 0.641s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Created reservations ['9dde9601-eb50-4838-abd4-db927fc2adf2', '967806fc-9709-47e1-9adc-a65d5e93dd86', '62dc7d82-f8fa-49c5-87f6-959f6b38dcb1', 'f18d9f06-cf31-4098-bc4d-0b00f45e28ec'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:46 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:03:46 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:46 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.237s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Deleted volume successfully. Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f14183e5-1453-461d-881d-f2023367310c tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-c83cae3b-be2e-4714-8351-ca2ff6bd8f75-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-167432bb-7a62-472f-aaca-ae079d0cb4bb-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-167432bb-7a62-472f-aaca-ae079d0cb4bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "cinder-quobyte-167432bb-7a62-472f-aaca-ae079d0cb4bb" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-167432bb-7a62-472f-aaca-ae079d0cb4bb" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e41ac22-7d7d-4ec8-b082-de2aa545704d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:46 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb Sep 07 10:03:46 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:47 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb" returned: 0 in 0.354s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:47 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb Sep 07 10:03:47 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:47 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-167432bb-7a62-472f-aaca-ae079d0cb4bb" returned: 0 in 0.252s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-quobyte-167432bb-7a62-472f-aaca-ae079d0cb4bb" released by "delete_volume" :: held 0.641s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Created reservations ['d5c480ef-0ab0-4963-81fb-d85769dd6d78', '3ee0a24c-3bb5-42d9-b23e-6c29498be6e3', '81374723-f15c-4381-b924-95c561489f70', 'e0bcec9a-e3f5-40af-b1e6-b1becc9b019a'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:47 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:03:47 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:47 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.241s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Deleted volume successfully. Sep 07 10:03:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-69efd0be-5592-4800-a2fb-2f5be4ff3cbe tempest-SnapshotDependencyTests-628970785 None] Lock "cinder-167432bb-7a62-472f-aaca-ae079d0cb4bb-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:03:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=31,cinder:INSERT=5,cinder:SELECT=25,cinder:DELETE=2 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (5a15c95e-8374-4c09-9cb2-618843565fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7df9546-ed52-46d7-a613-5e1ae91e0da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (ca02f55c-eb4a-4782-9d4d-83d3fb4ae175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c958b5a-b730-458f-ae93-a21b083104ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c958b5a-b730-458f-ae93-a21b083104ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-335424247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91507ee-b95b-4296-bfe1-3ab622aa194b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:09Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da03007-7c1a-410c-82e3-f8d0a5b2e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da03007-7c1a-410c-82e3-f8d0a5b2e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4077a3f7-473f-4a47-aa57-62967e903961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4077a3f7-473f-4a47-aa57-62967e903961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91507ee-b95b-4296-bfe1-3ab622aa194b', 'volume_name': 'volume-c91507ee-b95b-4296-bfe1-3ab622aa194b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e414f80a-2e41-4dcd-9596-99a6c432c840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e414f80a-2e41-4dcd-9596-99a6c432c840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce078d7-5731-4a08-a70b-4f56064f8402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume c91507ee-b95b-4296-bfe1-3ab622aa194b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91507ee-b95b-4296-bfe1-3ab622aa194b', 'volume_size': 1} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-335424247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91507ee-b95b-4296-bfe1-3ab622aa194b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:09Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Creating volume c91507ee-b95b-4296-bfe1-3ab622aa194b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:09 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7df9546-ed52-46d7-a613-5e1ae91e0da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934511226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70046963-7263-476e-be4e-3913d8fcdc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:09Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b 1073741824 Sep 07 10:04:09 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a8c743-6f0c-4ccb-ae8d-8c62693b97e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a8c743-6f0c-4ccb-ae8d-8c62693b97e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c5bc7a-4783-4bae-9eab-4cf5a5bf392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c5bc7a-4783-4bae-9eab-4cf5a5bf392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70046963-7263-476e-be4e-3913d8fcdc4c', 'volume_name': 'volume-70046963-7263-476e-be4e-3913d8fcdc4c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f735a234-153e-4686-944b-4ab99f690ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f735a234-153e-4686-944b-4ab99f690ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdd47ab-5b73-47f8-8d6e-161cc4fb83de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume 70046963-7263-476e-be4e-3913d8fcdc4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70046963-7263-476e-be4e-3913d8fcdc4c', 'volume_size': 1} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (5f472244-503e-43bd-a32f-a63e390ac571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d909a76-f54e-443e-8832-0ce1e9a3b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d909a76-f54e-443e-8832-0ce1e9a3b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567703548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce3dea7-3496-4355-8719-ae42c333bb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:10Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f655d629-9b52-4573-a793-1cdabaae2a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f655d629-9b52-4573-a793-1cdabaae2a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d51667-6fe3-4024-9b4b-8a3b480214e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d51667-6fe3-4024-9b4b-8a3b480214e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce3dea7-3496-4355-8719-ae42c333bb21', 'volume_name': 'volume-3ce3dea7-3496-4355-8719-ae42c333bb21', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b90e422-9007-4617-8f09-d07b356e9c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b90e422-9007-4617-8f09-d07b356e9c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0156bb8a-def4-4905-a2b9-39ea3a63441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Volume 3ce3dea7-3496-4355-8719-ae42c333bb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce3dea7-3496-4355-8719-ae42c333bb21', 'volume_size': 1} Sep 07 10:04:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:10 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b 1073741824" returned: 0 in 0.647s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:10 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b Sep 07 10:04:10 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (dd0ece18-90f0-437f-9aa5-6ba510384360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec32d43-f80b-4e34-a912-3a242f2b661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec32d43-f80b-4e34-a912-3a242f2b661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931981693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece587e5-98cb-4999-9ff3-e25df8987b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:10Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c8d258-e45d-414f-ba8f-d56df8c80150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c8d258-e45d-414f-ba8f-d56df8c80150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72e75e3-c725-470a-ad47-14e99b9e5db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72e75e3-c725-470a-ad47-14e99b9e5db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece587e5-98cb-4999-9ff3-e25df8987b23', 'volume_name': 'volume-ece587e5-98cb-4999-9ff3-e25df8987b23', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e24db31-4fd6-4324-a345-91761c968525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e24db31-4fd6-4324-a345-91761c968525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed36808-dd76-4076-ac0e-9178c48ffba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Volume ece587e5-98cb-4999-9ff3-e25df8987b23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece587e5-98cb-4999-9ff3-e25df8987b23', 'volume_size': 1} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:10 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b" returned: 0 in 0.312s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.962s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934511226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70046963-7263-476e-be4e-3913d8fcdc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:09Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Creating volume 70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:10 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce078d7-5731-4a08-a70b-4f56064f8402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91507ee-b95b-4296-bfe1-3ab622aa194b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224aa8c1-d93a-4295-a5f6-c4157878ccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c 1073741824 Sep 07 10:04:10 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume volume-c91507ee-b95b-4296-bfe1-3ab622aa194b (c91507ee-b95b-4296-bfe1-3ab622aa194b): created successfully Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224aa8c1-d93a-4295-a5f6-c4157878ccf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (ca02f55c-eb4a-4782-9d4d-83d3fb4ae175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-810bea7e-46c6-4dd7-a360-0d42c8fae1c5 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created volume successfully. Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (dc743fde-8605-4cde-81da-d95f5217a5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3308a789-824a-4450-90aa-77318558593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3308a789-824a-4450-90aa-77318558593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409406288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68cbb6c-70b8-4cf4-9773-4cf7cb500de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:11Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c596e1b3-dede-412d-ae94-e0e5e8c6f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c596e1b3-dede-412d-ae94-e0e5e8c6f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac6cb89-b82f-4261-a253-65eb95e27b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac6cb89-b82f-4261-a253-65eb95e27b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68cbb6c-70b8-4cf4-9773-4cf7cb500de7', 'volume_name': 'volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c8f535-64a3-41ff-80e7-d26f87cd9608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c8f535-64a3-41ff-80e7-d26f87cd9608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab616244-3f6d-4aa1-be08-5f312f973070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:10 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Volume e68cbb6c-70b8-4cf4-9773-4cf7cb500de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7', 'volume_size': 1} Sep 07 10:04:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (2da03e09-8041-45ec-85b8-fe237ed76103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c578fb-0bef-43ca-bd4d-7f0740e9ea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c578fb-0bef-43ca-bd4d-7f0740e9ea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421163165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ee38af-4b3b-449b-92da-34daed6b9b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:11Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fc55dc-4bdd-408b-88e9-ec52e78378cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fc55dc-4bdd-408b-88e9-ec52e78378cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026afae3-cc22-438f-a157-a5b2d3c2241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026afae3-cc22-438f-a157-a5b2d3c2241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ee38af-4b3b-449b-92da-34daed6b9b46', 'volume_name': 'volume-68ee38af-4b3b-449b-92da-34daed6b9b46', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26069e0d-b3b6-4dbb-997a-12deca87e561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26069e0d-b3b6-4dbb-997a-12deca87e561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de247ab-fc4e-4363-8112-efa4a7abd1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Volume 68ee38af-4b3b-449b-92da-34daed6b9b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ee38af-4b3b-449b-92da-34daed6b9b46', 'volume_size': 1} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:11 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c 1073741824" returned: 0 in 0.714s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:11 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c Sep 07 10:04:11 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (22aa7eef-1c13-4634-8b62-6c87ed8f1d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828641f1-5885-4458-b2e4-6f87aa663571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828641f1-5885-4458-b2e4-6f87aa663571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326347654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daf11cf-0ae6-4a14-9e68-327ff865bd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:12Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373e9a8e-9fee-4d22-a387-ee81a31ad13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373e9a8e-9fee-4d22-a387-ee81a31ad13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ddd15f-161e-4eb9-bec9-9448195dd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ddd15f-161e-4eb9-bec9-9448195dd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7daf11cf-0ae6-4a14-9e68-327ff865bd2c', 'volume_name': 'volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee67d0f-a4a5-4ac9-9ea6-b42a7f028660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee67d0f-a4a5-4ac9-9ea6-b42a7f028660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5730b46d-2868-4eda-a77a-faef8820cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Volume 7daf11cf-0ae6-4a14-9e68-327ff865bd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c', 'volume_size': 1} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c" returned: 0 in 0.510s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567703548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce3dea7-3496-4355-8719-ae42c333bb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:10Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Creating volume 3ce3dea7-3496-4355-8719-ae42c333bb21 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:11 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:11 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 1073741824 Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdd47ab-5b73-47f8-8d6e-161cc4fb83de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70046963-7263-476e-be4e-3913d8fcdc4c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:11 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92fe680-f007-4f32-8a2f-e04dfe910b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (bd07bca6-3224-4e2a-b75b-2c056362dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdf3aa6-92e7-4d96-906f-04a181c11afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume volume-70046963-7263-476e-be4e-3913d8fcdc4c (70046963-7263-476e-be4e-3913d8fcdc4c): created successfully Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92fe680-f007-4f32-8a2f-e04dfe910b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (5a15c95e-8374-4c09-9cb2-618843565fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdf3aa6-92e7-4d96-906f-04a181c11afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500f071b-baa9-40f9-9fac-2f095a8bdd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:12Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977457c1-2c2f-4595-956f-52c6e862fb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977457c1-2c2f-4595-956f-52c6e862fb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdeaa1d9-8c66-408d-b53c-4e84b6971fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdeaa1d9-8c66-408d-b53c-4e84b6971fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500f071b-baa9-40f9-9fac-2f095a8bdd9e', 'volume_name': 'volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71093ce-cab5-4d39-bbb8-c746efda0fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71093ce-cab5-4d39-bbb8-c746efda0fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa78333-616c-4824-b885-b89e230c91c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume 500f071b-baa9-40f9-9fac-2f095a8bdd9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e', 'volume_size': 1} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-be49edab-8975-4ad8-87c6-79ea6918236c tempest-CreateVolumesFromSnapshotTest-313643088 None] Created volume successfully. Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (43707e68-9418-46f5-badf-c17cdca16707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a347dd4-00aa-4dc7-8075-cc251d0b18b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 1073741824" returned: 0 in 0.651s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a347dd4-00aa-4dc7-8075-cc251d0b18b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010715086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93d45ff-5b9a-44b8-a6c1-26a65963ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:12Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032b79f1-db5b-4d6f-8d5f-16fc5681fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032b79f1-db5b-4d6f-8d5f-16fc5681fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade2329d-b6dd-4b6f-ade6-f3bc5a291b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade2329d-b6dd-4b6f-ade6-f3bc5a291b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93d45ff-5b9a-44b8-a6c1-26a65963ce06', 'volume_name': 'volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecab58f-a753-45f3-b642-0744d3799cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecab58f-a753-45f3-b642-0744d3799cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d30b829-984c-4a8f-a338-e20d5c6cca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume d93d45ff-5b9a-44b8-a6c1-26a65963ce06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06', 'volume_size': 1} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:12 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 Sep 07 10:04:12 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (a1b50340-a355-4328-b4d8-0e29938aaef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b94c7-2aab-4c40-ab56-477c95672710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b94c7-2aab-4c40-ab56-477c95672710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901853934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcaba08-4d1f-4648-80f0-23893a97f671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:13Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f753f0-3e23-4d51-b8eb-a1fe737b39b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f753f0-3e23-4d51-b8eb-a1fe737b39b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc04283-7f5d-40e2-b294-b36533b7be3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc04283-7f5d-40e2-b294-b36533b7be3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fcaba08-4d1f-4648-80f0-23893a97f671', 'volume_name': 'volume-0fcaba08-4d1f-4648-80f0-23893a97f671', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33679241-8bb4-46dc-9dcb-f376326d4283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33679241-8bb4-46dc-9dcb-f376326d4283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6466de81-f981-46d8-8fb8-a5410e8909fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume 0fcaba08-4d1f-4648-80f0-23893a97f671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fcaba08-4d1f-4648-80f0-23893a97f671', 'volume_size': 1} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21" returned: 0 in 0.357s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.689s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931981693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece587e5-98cb-4999-9ff3-e25df8987b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:10Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Creating volume ece587e5-98cb-4999-9ff3-e25df8987b23 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:13 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0156bb8a-def4-4905-a2b9-39ea3a63441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce3dea7-3496-4355-8719-ae42c333bb21', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 1073741824 Sep 07 10:04:13 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb45ed7-0195-48b7-8971-354e1a132a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Volume volume-3ce3dea7-3496-4355-8719-ae42c333bb21 (3ce3dea7-3496-4355-8719-ae42c333bb21): created successfully Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb45ed7-0195-48b7-8971-354e1a132a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (5f472244-503e-43bd-a32f-a63e390ac571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f75da4d6-63bf-4027-8273-6323b2dad06a tempest-CreateVolumesFromImageTest-807388249 None] Created volume successfully. Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (a0beddde-388c-4666-bbb9-c1eba3caf05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a052d73-24e1-41a4-821c-936ec94f2772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a052d73-24e1-41a4-821c-936ec94f2772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237911383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7276b0f-22c8-4166-9fb4-973851ad153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:13Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410bc482-b232-4db7-8fac-503306d27f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410bc482-b232-4db7-8fac-503306d27f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc522291-8614-44b5-8261-23c8469aa6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc522291-8614-44b5-8261-23c8469aa6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7276b0f-22c8-4166-9fb4-973851ad153b', 'volume_name': 'volume-c7276b0f-22c8-4166-9fb4-973851ad153b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08487df-d282-4467-9a2b-c6ef53320eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08487df-d282-4467-9a2b-c6ef53320eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bda6a5-aae8-42b9-95ee-000e80c26c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume c7276b0f-22c8-4166-9fb4-973851ad153b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7276b0f-22c8-4166-9fb4-973851ad153b', 'volume_size': 1} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:13 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 1073741824" returned: 0 in 0.577s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:13 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 Sep 07 10:04:13 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:14 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23" returned: 0 in 0.364s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.139s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409406288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68cbb6c-70b8-4cf4-9773-4cf7cb500de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:11Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Creating volume e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:14 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:14 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 1073741824 Sep 07 10:04:14 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed36808-dd76-4076-ac0e-9178c48ffba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece587e5-98cb-4999-9ff3-e25df8987b23', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61762a63-c808-471d-9aed-33798ebe4301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Volume volume-ece587e5-98cb-4999-9ff3-e25df8987b23 (ece587e5-98cb-4999-9ff3-e25df8987b23): created successfully Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61762a63-c808-471d-9aed-33798ebe4301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (dd0ece18-90f0-437f-9aa5-6ba510384360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (eedc7fe6-4d0b-40e8-aa31-8d5f61156bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938832d4-a82d-4814-86ce-6944de60e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-48caeee0-cb73-4166-88c1-233ca6ef07e3 tempest-CreateVolumesFromImageTest-807388249 None] Created volume successfully. Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938832d4-a82d-4814-86ce-6944de60e18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1726499562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559552d0-f0d0-4088-b0e9-1147e8ed682b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:14Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da421af3-94b6-40d9-bcc4-36b82dd354c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da421af3-94b6-40d9-bcc4-36b82dd354c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff118f7-777e-4655-9482-2458600dd7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff118f7-777e-4655-9482-2458600dd7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559552d0-f0d0-4088-b0e9-1147e8ed682b', 'volume_name': 'volume-559552d0-f0d0-4088-b0e9-1147e8ed682b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241570bd-6e13-40b9-8ff2-5789560226c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241570bd-6e13-40b9-8ff2-5789560226c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3420cdd8-f084-4c49-a6f0-f8ffc708c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume 559552d0-f0d0-4088-b0e9-1147e8ed682b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559552d0-f0d0-4088-b0e9-1147e8ed682b', 'volume_size': 1} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Flow 'volume_create_manager' (d4be8375-b3af-4cb9-b6fc-d1be8c45f718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5563fbe-8f63-4657-bf8d-01db95706cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5563fbe-8f63-4657-bf8d-01db95706cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3581ae09-cb07-455d-9276-ae36a21e3c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6455e33bcbfe4907beacd3beff800f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:14Z,use_quota=True,user_id='e427390c26af4473aedecefa6f2d718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93a6334d-78a4-4df8-af6c-bc064c8ea4aa),volume_type_id=93a6334d-78a4-4df8-af6c-bc064c8ea4aa)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433ac6ea-9225-4cdd-a1bc-1d60ab78840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433ac6ea-9225-4cdd-a1bc-1d60ab78840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6829e971-4a73-4863-9650-97e678c0b84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:04:14 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 1073741824" returned: 0 in 0.543s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:14 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 Sep 07 10:04:14 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6829e971-4a73-4863-9650-97e678c0b84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3581ae09-cb07-455d-9276-ae36a21e3c1b', 'volume_name': 'volume-3581ae09-cb07-455d-9276-ae36a21e3c1b', 'volume_size': 1, 'image_id': 'a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f26964f21530a5ae357c360a2694e57d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6455e33bcbfe4907beacd3beff800f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef5916524a3a3e26d5b7bcb191713ad8dc843556fe51270d876ce7fcd80e93c01ec65b17c8349798b3f0d60143e51aa8681bb732592b97fb00b5be5e28cba8dd', 'id': 'a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'created_at': datetime.datetime(2026, 9, 7, 8, 4, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 4, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0afd3317-c4e5-485a-b0fb-20ce440ec9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0afd3317-c4e5-485a-b0fb-20ce440ec9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44038b8a-36d6-4423-84e8-eb83e011f727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:14 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Volume 3581ae09-cb07-455d-9276-ae36a21e3c1b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3581ae09-cb07-455d-9276-ae36a21e3c1b', 'volume_size': 1, 'image_id': 'a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f26964f21530a5ae357c360a2694e57d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6455e33bcbfe4907beacd3beff800f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef5916524a3a3e26d5b7bcb191713ad8dc843556fe51270d876ce7fcd80e93c01ec65b17c8349798b3f0d60143e51aa8681bb732592b97fb00b5be5e28cba8dd', 'id': 'a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'created_at': datetime.datetime(2026, 9, 7, 8, 4, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 4, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Trying to clone 3581ae09-cb07-455d-9276-ae36a21e3c1b from image a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:04:14 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Image download 0.00 MB at 0.00 MB/s Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a37e46-8b6b-4868-b5ab-affe7321211a]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:14 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7" returned: 0 in 0.309s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.703s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421163165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ee38af-4b3b-449b-92da-34daed6b9b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:11Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Creating volume 68ee38af-4b3b-449b-92da-34daed6b9b46 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:14 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab616244-3f6d-4aa1-be08-5f312f973070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c27d22-7c4e-4a7d-b98a-4ab45940bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:15 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 1073741824 Sep 07 10:04:15 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:15 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Volume volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 (e68cbb6c-70b8-4cf4-9773-4cf7cb500de7): created successfully Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c27d22-7c4e-4a7d-b98a-4ab45940bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (dc743fde-8605-4cde-81da-d95f5217a5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e991940f-583b-49a0-a2dc-7519a102321b tempest-CreateVolumesFromImageTest-807388249 None] Created volume successfully. Sep 07 10:04:15 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD Sep 07 10:04:15 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:15 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:15 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD Sep 07 10:04:15 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:15 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 1073741824" returned: 0 in 0.515s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:15 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 Sep 07 10:04:15 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:15 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Temporary image a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 is fetched for user e427390c26af4473aedecefa6f2d718b. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddfe0bc-3336-4649-a639-c3a7a1f89674]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:15 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46" returned: 0 in 0.282s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.970s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326347654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daf11cf-0ae6-4a14-9e68-327ff865bd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13ebfd3a6e477cb392bf5c2580f98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:12Z,use_quota=True,user_id='710e5de0661b408fb95318ab23009288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Creating volume 7daf11cf-0ae6-4a14-9e68-327ff865bd2c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:15 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de247ab-fc4e-4363-8112-efa4a7abd1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ee38af-4b3b-449b-92da-34daed6b9b46', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:15 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c 1073741824 Sep 07 10:04:15 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:15 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD Sep 07 10:04:15 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc3719a-0f7d-4f0a-bc6b-7a4bc82059e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:15 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Volume volume-68ee38af-4b3b-449b-92da-34daed6b9b46 (68ee38af-4b3b-449b-92da-34daed6b9b46): created successfully Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc3719a-0f7d-4f0a-bc6b-7a4bc82059e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (2da03e09-8041-45ec-85b8-fe237ed76103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-12cdc2b2-1015-4ccf-b50a-a6116321ced9 tempest-CreateVolumesFromImageTest-807388249 None] Created volume successfully. Sep 07 10:04:16 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:16 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c 1073741824" returned: 0 in 0.441s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:16 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD Sep 07 10:04:16 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:16 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c Sep 07 10:04:16 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:16 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:16 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c" returned: 0 in 0.294s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.567s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500f071b-baa9-40f9-9fac-2f095a8bdd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:12Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Creating volume 500f071b-baa9-40f9-9fac-2f095a8bdd9e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:16 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5730b46d-2868-4eda-a77a-faef8820cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:16 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e 1073741824 Sep 07 10:04:16 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763037fe-0656-4dc3-b4bc-6c1a75579357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Volume volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c (7daf11cf-0ae6-4a14-9e68-327ff865bd2c): created successfully Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763037fe-0656-4dc3-b4bc-6c1a75579357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Flow 'volume_create_manager' (22aa7eef-1c13-4634-8b62-6c87ed8f1d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:16 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bc523553-5196-4816-a9b1-fe4687aeadf6 tempest-CreateVolumesFromImageTest-807388249 None] Created volume successfully. Sep 07 10:04:17 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e 1073741824" returned: 0 in 0.445s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:17 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e Sep 07 10:04:17 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:17 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.746s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010715086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93d45ff-5b9a-44b8-a6c1-26a65963ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:12Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Creating volume d93d45ff-5b9a-44b8-a6c1-26a65963ce06 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:17 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa78333-616c-4824-b885-b89e230c91c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd59d643-281c-42a2-930f-de801f3f5e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:17 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 1073741824 Sep 07 10:04:17 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:17 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e (500f071b-baa9-40f9-9fac-2f095a8bdd9e): created successfully Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd59d643-281c-42a2-930f-de801f3f5e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (bd07bca6-3224-4e2a-b75b-2c056362dd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e319aec2-d58a-4093-86c3-45b43b52c140 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created volume successfully. Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-7daf11cf-0ae6-4a14-9e68-327ff865bd2c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-7daf11cf-0ae6-4a14-9e68-327ff865bd2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-quobyte-7daf11cf-0ae6-4a14-9e68-327ff865bd2c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-7daf11cf-0ae6-4a14-9e68-327ff865bd2c" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ea57af-abd7-4c3b-8d8b-eb38c680dd8d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:17 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c Sep 07 10:04:17 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:17 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 1073741824" returned: 0 in 0.463s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:17 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 Sep 07 10:04:17 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:18 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c" returned: 0 in 0.391s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:18 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c Sep 07 10:04:18 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:18 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06" returned: 0 in 0.281s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.501s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d30b829-984c-4a8f-a338-e20d5c6cca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3fd445-ecf2-4805-ac76-5e0fc6ecb9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Creating offline snapshot cb57234b-22b6-4e5b-85d3-c25c36c77996 of volume 70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:04:18 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 (d93d45ff-5b9a-44b8-a6c1-26a65963ce06): created successfully Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3fd445-ecf2-4805-ac76-5e0fc6ecb9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (43707e68-9418-46f5-badf-c17cdca16707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[26972da6-21fe-45d1-a8b7-8a03a2b3f70f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d53861f9-a752-4139-912b-501d003cf44a tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created volume successfully. Sep 07 10:04:18 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7daf11cf-0ae6-4a14-9e68-327ff865bd2c" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-7daf11cf-0ae6-4a14-9e68-327ff865bd2c" released by "delete_volume" :: held 0.713s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:18 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c Sep 07 10:04:18 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Created reservations ['e23f72f7-9bd7-4734-9c41-2d9b9337cd06', '00636d9f-6a6a-4cf6-8625-3816fbcd5b8a', '6003a52f-8f04-4c27-bb34-ed8725cfa6a2', '922de998-63cb-43e4-a456-4fc3331f5211'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:18 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:18 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:18 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c" returned: 0 in 0.429s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:18 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 1G Sep 07 10:04:18 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-68ee38af-4b3b-449b-92da-34daed6b9b46-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-68ee38af-4b3b-449b-92da-34daed6b9b46-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:18 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.307s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-quobyte-68ee38af-4b3b-449b-92da-34daed6b9b46" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Deleted volume successfully. Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-68ee38af-4b3b-449b-92da-34daed6b9b46" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-57696fc9-919d-4685-ba41-678fd3ddf9d8 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-7daf11cf-0ae6-4a14-9e68-327ff865bd2c-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb1728e-a79c-48af-9409-f1ef254c5118]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:19 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 Sep 07 10:04:19 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 1G" returned: 0 in 0.465s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70046963-7263-476e-be4e-3913d8fcdc4c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:19 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70046963-7263-476e-be4e-3913d8fcdc4c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 Sep 07 10:04:19 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46" returned: 0 in 0.379s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:19 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46 Sep 07 10:04:19 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70046963-7263-476e-be4e-3913d8fcdc4c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996" returned: 0 in 0.319s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:19 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 is being set with open permissions: ugo+rw Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:19 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 Sep 07 10:04:19 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-68ee38af-4b3b-449b-92da-34daed6b9b46" returned: 0 in 0.273s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-68ee38af-4b3b-449b-92da-34daed6b9b46" released by "delete_volume" :: held 0.694s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Created reservations ['84f90ada-e880-4b78-9fca-6e7c5d2fce2a', '960a58cb-21fe-4c49-917a-2c831cf115f5', '17d5d8df-bf47-4397-889e-f89782da463d', '7be3dfbe-9391-4017-8000-640eb90a5f07'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:19 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:19 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996" returned: 0 in 0.288s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:19 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.info Sep 07 10:04:19 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:20 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.273s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Deleted volume successfully. Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a20849f-1dae-4cb5-96b4-0668fbf57884 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-68ee38af-4b3b-449b-92da-34daed6b9b46-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-quobyte-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:20 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.info" returned: 0 in 0.303s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:20 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.info is being set with open permissions: ugo+rw Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2ecb0-7bf4-422f-bc4f-fb75e74a9c38]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:20 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.info Sep 07 10:04:20 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:20 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 Sep 07 10:04:20 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:20 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.info" returned: 0 in 0.261s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.329s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901853934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcaba08-4d1f-4648-80f0-23893a97f671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:13Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Creating volume 0fcaba08-4d1f-4648-80f0-23893a97f671 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:20 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:20 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 1073741824 Sep 07 10:04:20 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-792deab6-2d93-46c9-adca-2f7d9a370685 tempest-CreateVolumesFromSnapshotTest-313643088 None] Create snapshot completed successfully Sep 07 10:04:20 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7" returned: 0 in 0.400s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:20 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7 Sep 07 10:04:20 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:20 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7" returned: 0 in 0.255s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7" released by "delete_volume" :: held 0.704s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Created reservations ['a9664d5c-6b41-45ba-b22e-c8fa16acfd50', 'ec941d46-4a61-4d3b-ab6a-b9da69fb3c3c', '106ff71d-3a1b-49d1-9e84-b58ad14a073b', '732b333e-526b-414d-86a1-5227731cc4a5'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:20 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 1073741824" returned: 0 in 0.471s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:20 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 Sep 07 10:04:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:20 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:20 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:20 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:21 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.614s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237911383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7276b0f-22c8-4166-9fb4-973851ad153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:13Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Creating volume c7276b0f-22c8-4166-9fb4-973851ad153b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:21 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:21 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:21 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b 1073741824 Sep 07 10:04:21 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-ece587e5-98cb-4999-9ff3-e25df8987b23-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6466de81-f981-46d8-8fb8-a5410e8909fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcaba08-4d1f-4648-80f0-23893a97f671', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8880988c-2bac-416b-bb77-74252b093e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Deleted volume successfully. Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-ece587e5-98cb-4999-9ff3-e25df8987b23-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume volume-0fcaba08-4d1f-4648-80f0-23893a97f671 (0fcaba08-4d1f-4648-80f0-23893a97f671): created successfully Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8880988c-2bac-416b-bb77-74252b093e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (a1b50340-a355-4328-b4d8-0e29938aaef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0fdb139a-ba6d-4f8c-9f12-bd47ff2f4120 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-e68cbb6c-70b8-4cf4-9773-4cf7cb500de7-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-62c6f737-c560-4439-8b64-2863069d10eb tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created volume successfully. Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-quobyte-ece587e5-98cb-4999-9ff3-e25df8987b23" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-ece587e5-98cb-4999-9ff3-e25df8987b23" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82dee68-a69b-46fc-928a-9d17116e0c29]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:21 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 Sep 07 10:04:21 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:21 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b 1073741824" returned: 0 in 0.518s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:21 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b Sep 07 10:04:21 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:21 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (a77fe5a1-2a99-4cde-933c-435feaa1c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1305af32-702d-46cc-9cf2-207b57fb0b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23" returned: 0 in 0.542s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1305af32-702d-46cc-9cf2-207b57fb0b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1723056498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:22Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23 Sep 07 10:04:21 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a1a8f8-230b-4dab-af70-a415a9fc2475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a1a8f8-230b-4dab-af70-a415a9fc2475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f788f88-aee2-44ed-b3b9-099262e8d337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f788f88-aee2-44ed-b3b9-099262e8d337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586', 'volume_name': 'volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5debf87-085a-41c3-90f3-cf1a12bad911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5debf87-085a-41c3-90f3-cf1a12bad911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f085e932-bdd7-471c-a474-dd1e6222c978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume 2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586', 'volume_size': 1} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:22 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b" returned: 0 in 0.297s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.749s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1726499562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559552d0-f0d0-4088-b0e9-1147e8ed682b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea503eaeb94afe8c6602d7edd6b111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:14Z,use_quota=True,user_id='34e545f64bca496080896350e2bf1184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Creating volume 559552d0-f0d0-4088-b0e9-1147e8ed682b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:22 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:22 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b 1073741824 Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bda6a5-aae8-42b9-95ee-000e80c26c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7276b0f-22c8-4166-9fb4-973851ad153b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc973330-ba01-4e03-9b98-271e8f02529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume volume-c7276b0f-22c8-4166-9fb4-973851ad153b (c7276b0f-22c8-4166-9fb4-973851ad153b): created successfully Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc973330-ba01-4e03-9b98-271e8f02529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (a0beddde-388c-4666-bbb9-c1eba3caf05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:22 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-90c557ff-dd1d-4a1d-a2af-9522fc65ff80 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created volume successfully. Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:22 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (8d5ea820-b431-4c00-bb97-b2e5a66dadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc698915-6c38-4b09-9328-0d2c61ef76cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ece587e5-98cb-4999-9ff3-e25df8987b23" returned: 0 in 0.380s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc698915-6c38-4b09-9328-0d2c61ef76cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108326198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26752331-530f-4544-b734-2bb240453f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:22Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974a8180-c478-42ea-b1b6-498a82c83620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974a8180-c478-42ea-b1b6-498a82c83620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c39a55-cccf-45be-a37d-9a685c08a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c39a55-cccf-45be-a37d-9a685c08a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26752331-530f-4544-b734-2bb240453f69', 'volume_name': 'volume-26752331-530f-4544-b734-2bb240453f69', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9814e634-1706-4202-9ac6-94a5e27e19ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9814e634-1706-4202-9ac6-94a5e27e19ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97bf5b3-a2eb-4159-b4e5-e2332f9db521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume 26752331-530f-4544-b734-2bb240453f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26752331-530f-4544-b734-2bb240453f69', 'volume_size': 1} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-ece587e5-98cb-4999-9ff3-e25df8987b23" released by "delete_volume" :: held 1.032s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Created reservations ['433fd44b-9d5f-4fdb-91ab-d879921999c4', '38c51074-8670-42a5-a71c-1de08dd26f83', '02afb86c-0385-4356-a79d-5598a8310fb4', 'f8e90e70-3ba1-4bb2-bd64-cd29245d7a3e'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:22 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:22 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:22 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (214397e8-b414-41f7-afc0-e57bf5ba798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af95ea7-7a63-4396-88c1-1eff81212496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b 1073741824" returned: 0 in 0.714s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af95ea7-7a63-4396-88c1-1eff81212496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1095750162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:23Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e85e49-e044-4034-8a6c-c65179563b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e85e49-e044-4034-8a6c-c65179563b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa2fddd-4191-4b51-a08f-57908ccbff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa2fddd-4191-4b51-a08f-57908ccbff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46', 'volume_name': 'volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29adcd2e-983d-4d74-9914-8173f355aac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29adcd2e-983d-4d74-9914-8173f355aac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ea8ba-44ad-4f54-8a05-f220370b801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume 82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46', 'volume_size': 1} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:22 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.321s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:22 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Deleted volume successfully. Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:22 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b Sep 07 10:04:22 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:22 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-59e8a19a-c0da-4221-8146-30ccef6fa058 tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-ece587e5-98cb-4999-9ff3-e25df8987b23-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (b14867fc-40d1-4b70-aff9-f34465d1dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0977b2c5-7717-4547-81fd-e9751234d8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0977b2c5-7717-4547-81fd-e9751234d8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271357868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d5190-a496-4674-b952-ea5a57ef94d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:23Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8b40c1-aff1-4949-97cc-cbf1d89b1934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8b40c1-aff1-4949-97cc-cbf1d89b1934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74689d7-ac28-4aea-a501-027bb03cee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74689d7-ac28-4aea-a501-027bb03cee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256d5190-a496-4674-b952-ea5a57ef94d0', 'volume_name': 'volume-256d5190-a496-4674-b952-ea5a57ef94d0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495ad9f1-2dd5-4c0e-bdd0-9c8eb88b748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495ad9f1-2dd5-4c0e-bdd0-9c8eb88b748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a96ccb6-dd06-4f70-be29-0d09b2a8ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume 256d5190-a496-4674-b952-ea5a57ef94d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256d5190-a496-4674-b952-ea5a57ef94d0', 'volume_size': 1} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b" returned: 0 in 0.360s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.735s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3581ae09-cb07-455d-9276-ae36a21e3c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6455e33bcbfe4907beacd3beff800f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:14Z,use_quota=True,user_id='e427390c26af4473aedecefa6f2d718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93a6334d-78a4-4df8-af6c-bc064c8ea4aa),volume_type_id=93a6334d-78a4-4df8-af6c-bc064c8ea4aa)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Creating volume 3581ae09-cb07-455d-9276-ae36a21e3c1b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:23 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3420cdd8-f084-4c49-a6f0-f8ffc708c72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559552d0-f0d0-4088-b0e9-1147e8ed682b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b 1073741824 Sep 07 10:04:23 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12c66d-c205-4bf0-aaa7-04cce4e2f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Volume volume-559552d0-f0d0-4088-b0e9-1147e8ed682b (559552d0-f0d0-4088-b0e9-1147e8ed682b): created successfully Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12c66d-c205-4bf0-aaa7-04cce4e2f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Flow 'volume_create_manager' (eedc7fe6-4d0b-40e8-aa31-8d5f61156bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c301a79f-2f63-4967-ae54-8021b6f4f3ae tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created volume successfully. Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-3ce3dea7-3496-4355-8719-ae42c333bb21-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-3ce3dea7-3496-4355-8719-ae42c333bb21-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (90f3dadc-96b7-4c3a-8f09-1b20c733a4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eeb2c0-cd52-4fc3-be57-3c0d49b3eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eeb2c0-cd52-4fc3-be57-3c0d49b3eb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030168952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fff2b5-d72d-462b-8192-acef0cc254db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:24Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260c0c98-0c83-4722-bf42-1981e9dd9a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260c0c98-0c83-4722-bf42-1981e9dd9a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8dc427-5340-4f60-b419-40399d5b794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8dc427-5340-4f60-b419-40399d5b794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fff2b5-d72d-462b-8192-acef0cc254db', 'volume_name': 'volume-04fff2b5-d72d-462b-8192-acef0cc254db', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31da8546-ae6a-4473-b9bd-50c331ba2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31da8546-ae6a-4473-b9bd-50c331ba2726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4ce84-5c6b-4b42-b497-84daf1579925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:23 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume 04fff2b5-d72d-462b-8192-acef0cc254db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fff2b5-d72d-462b-8192-acef0cc254db', 'volume_size': 1} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "cinder-quobyte-3ce3dea7-3496-4355-8719-ae42c333bb21" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-3ce3dea7-3496-4355-8719-ae42c333bb21" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea56e92-46fc-4048-86d9-a9dfd5a99727]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:23 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b 1073741824" returned: 0 in 0.492s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:23 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b Sep 07 10:04:23 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:23 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 Sep 07 10:04:23 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-559552d0-f0d0-4088-b0e9-1147e8ed682b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-559552d0-f0d0-4088-b0e9-1147e8ed682b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:24 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.103s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1723056498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:22Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Creating volume 2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:24 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 1073741824 Sep 07 10:04:24 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21" returned: 0 in 0.431s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Attempting download of a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 ((None, [{'url': 'file:///opt/stack/data/glance/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'metadata': {}}])) to volume 3581ae09-cb07-455d-9276-ae36a21e3c1b. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:04:24 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21 Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-quobyte-559552d0-f0d0-4088-b0e9-1147e8ed682b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:24 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-559552d0-f0d0-4088-b0e9-1147e8ed682b" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c9ee6-d22d-4b6b-920d-092368293056]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d46c56-6b05-454c-b4dd-8bab38ef950f]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_af36p28a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b Sep 07 10:04:24 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_af36p28a Sep 07 10:04:24 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3ce3dea7-3496-4355-8719-ae42c333bb21" returned: 0 in 0.316s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-quobyte-3ce3dea7-3496-4355-8719-ae42c333bb21" released by "delete_volume" :: held 0.810s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Created reservations ['85ebcab3-bb30-458a-864d-f4f5477804dc', '1b6695d1-7ed3-4925-8d84-5aac1d650250', '5119dbcf-8ba8-48fb-b8e5-8fa1228e577a', '237362e9-1124-4582-915a-7ff0dbeddf1f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:24 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b" returned: 0 in 0.432s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:24 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 1073741824" returned: 0 in 0.589s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_af36p28a" returned: 0 in 0.448s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:24 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b Sep 07 10:04:24 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_af36p28a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:24 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:24 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_af36p28a Sep 07 10:04:24 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:24 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 Sep 07 10:04:24 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:25 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-559552d0-f0d0-4088-b0e9-1147e8ed682b" returned: 0 in 0.385s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-559552d0-f0d0-4088-b0e9-1147e8ed682b" released by "delete_volume" :: held 0.897s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:25 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_af36p28a" returned: 1 in 0.492s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_af36p28a' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3a8b13-f4b2-4000-b131-e76b56f83c01]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created reservations ['dcafdce7-826d-4a24-8ad4-8da0db82267b', '52142cdb-a4b4-48eb-82e3-f7b9ca48b7da', '4b96eb8f-6774-4223-b745-4457434a78b6', '7caa096a-d86f-42c4-9039-5df4dc704000'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:25 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.515s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Deleted volume successfully. Sep 07 10:04:25 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:25 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD Sep 07 10:04:25 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-67194d74-ac5c-4143-bd29-3ec917bc1c6c tempest-CreateVolumesFromImageTest-807388249 None] Lock "cinder-3ce3dea7-3496-4355-8719-ae42c333bb21-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586" returned: 0 in 0.551s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.047s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108326198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26752331-530f-4544-b734-2bb240453f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:22Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Creating volume 26752331-530f-4544-b734-2bb240453f69 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:25 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:25 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:25 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:25 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 1073741824 Sep 07 10:04:25 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f085e932-bdd7-471c-a474-dd1e6222c978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31392fc-ada1-42f4-9a6c-23653e3aa8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:25 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 (2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586): created successfully Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31392fc-ada1-42f4-9a6c-23653e3aa8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (a77fe5a1-2a99-4cde-933c-435feaa1c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e246bfb7-d675-4d91-9e81-83a885b08677 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created volume successfully. Sep 07 10:04:25 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:25 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.405s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Deleted volume successfully. Sep 07 10:04:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4343642c-8e82-4295-9263-735071f2fac7 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-559552d0-f0d0-4088-b0e9-1147e8ed682b-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:25 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD Sep 07 10:04:25 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:26 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 1073741824" returned: 0 in 0.589s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:26 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 Sep 07 10:04:26 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:26 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 was raw, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:26 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b Sep 07 10:04:26 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:26 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69" returned: 0 in 0.290s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.497s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1095750162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:23Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Creating volume 82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:26 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-c7276b0f-22c8-4166-9fb4-973851ad153b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:26 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 1073741824 Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97bf5b3-a2eb-4159-b4e5-e2332f9db521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26752331-530f-4544-b734-2bb240453f69', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024b7538-7a5d-4d73-bcf6-9621ccf0cb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-c7276b0f-22c8-4166-9fb4-973851ad153b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:26 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume volume-26752331-530f-4544-b734-2bb240453f69 (26752331-530f-4544-b734-2bb240453f69): created successfully Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024b7538-7a5d-4d73-bcf6-9621ccf0cb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (8d5ea820-b431-4c00-bb97-b2e5a66dadb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-c9801fed-cf57-44f0-984d-6038650e8676 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created volume successfully. Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-quobyte-c7276b0f-22c8-4166-9fb4-973851ad153b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-c7276b0f-22c8-4166-9fb4-973851ad153b" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c6ae0-3e93-477e-b798-67a58d48b1ee]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:26 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b Sep 07 10:04:26 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:26 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b" returned: 0 in 0.648s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04_tvcrqmsqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:04:26 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 10:04:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:26 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b 1G Sep 07 10:04:26 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:27 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 1073741824" returned: 0 in 0.626s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b" returned: 0 in 0.457s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:27 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b Sep 07 10:04:27 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:27 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 Sep 07 10:04:27 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:27 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b 1G" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Downloaded image a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 ((None, [{'url': 'file:///opt/stack/data/glance/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'metadata': {}}])) to volume 3581ae09-cb07-455d-9276-ae36a21e3c1b successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Temporary image a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 for user e427390c26af4473aedecefa6f2d718b is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Marking volume 3581ae09-cb07-455d-9276-ae36a21e3c1b as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Copying metadata from image a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 to 3581ae09-cb07-455d-9276-ae36a21e3c1b. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Creating volume glance metadata for volume 3581ae09-cb07-455d-9276-ae36a21e3c1b backed by image a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f26964f21530a5ae357c360a2694e57d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:04:27 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c7276b0f-22c8-4166-9fb4-973851ad153b" returned: 0 in 0.302s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-c7276b0f-22c8-4166-9fb4-973851ad153b" released by "delete_volume" :: held 0.814s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44038b8a-36d6-4423-84e8-eb83e011f727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3581ae09-cb07-455d-9276-ae36a21e3c1b', 'volume_size': 1, 'image_id': 'a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f26964f21530a5ae357c360a2694e57d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6455e33bcbfe4907beacd3beff800f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef5916524a3a3e26d5b7bcb191713ad8dc843556fe51270d876ce7fcd80e93c01ec65b17c8349798b3f0d60143e51aa8681bb732592b97fb00b5be5e28cba8dd', 'id': 'a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04', 'created_at': datetime.datetime(2026, 9, 7, 8, 4, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 4, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a163d3c3-8be9-43bb-8e3a-dd5b3bd94c04/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4fbf65-65a9-40d2-834c-5170df7e4629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:27 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46" returned: 0 in 0.345s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.154s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271357868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d5190-a496-4674-b952-ea5a57ef94d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:23Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Creating volume 256d5190-a496-4674-b952-ea5a57ef94d0 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:27 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:27 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Volume volume-3581ae09-cb07-455d-9276-ae36a21e3c1b (3581ae09-cb07-455d-9276-ae36a21e3c1b): created successfully Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4fbf65-65a9-40d2-834c-5170df7e4629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:27 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 1073741824 Sep 07 10:04:27 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Flow 'volume_create_manager' (d4be8375-b3af-4cb9-b6fc-d1be8c45f718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ea8ba-44ad-4f54-8a05-f220370b801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21d9f00-d09e-44d8-a7be-402a2efb7db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9ac17a99-6632-4771-9bfe-94a236b22f0e tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Created volume successfully. Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created reservations ['7dab03c9-8c81-490c-8ba3-0d2eb8e6e30f', 'dc65f1d3-c438-4b67-b611-e1dafff5e686', 'bbdaa31b-a1a6-4f39-ba0f-0d0b1114eb1b', '99c8d862-2cab-448b-986a-82131cc4e715'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:27 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 (82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46): created successfully Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21d9f00-d09e-44d8-a7be-402a2efb7db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (214397e8-b414-41f7-afc0-e57bf5ba798c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d16e1728-9a33-4bcd-803b-4d64a704423c tempest-CreateVolumesFromSnapshotTest-313643088 None] Created volume successfully. Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:27 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:27 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:27 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Deleted volume successfully. Sep 07 10:04:27 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 1073741824" returned: 0 in 0.481s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5ccf537f-e21b-472c-9bdb-cafad13e08a3 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-c7276b0f-22c8-4166-9fb4-973851ad153b-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:27 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 Sep 07 10:04:27 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:28 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0" returned: 0 in 0.260s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.537s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030168952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fff2b5-d72d-462b-8192-acef0cc254db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeb24bdb79b4da499a1d1228fba31f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:24Z,use_quota=True,user_id='d85249901f684940acebed5d916f1481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Creating volume 04fff2b5-d72d-462b-8192-acef0cc254db {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:28 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a96ccb6-dd06-4f70-be29-0d09b2a8ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256d5190-a496-4674-b952-ea5a57ef94d0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4da9f5-d5e8-4032-8276-ad22afe1f5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:28 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db 1073741824 Sep 07 10:04:28 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:28 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume volume-256d5190-a496-4674-b952-ea5a57ef94d0 (256d5190-a496-4674-b952-ea5a57ef94d0): created successfully Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4da9f5-d5e8-4032-8276-ad22afe1f5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (b14867fc-40d1-4b70-aff9-f34465d1dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9323eb20-02ea-49ac-8a82-8b1927349124 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created volume successfully. Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Acquiring lock "cinder-3581ae09-cb07-455d-9276-ae36a21e3c1b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "cinder-3581ae09-cb07-455d-9276-ae36a21e3c1b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Acquiring lock "cinder-quobyte-3581ae09-cb07-455d-9276-ae36a21e3c1b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "cinder-quobyte-3581ae09-cb07-455d-9276-ae36a21e3c1b" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9989f7ea-bd5c-4080-8ee2-0f701db39129]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-0fcaba08-4d1f-4648-80f0-23893a97f671-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-0fcaba08-4d1f-4648-80f0-23893a97f671-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:28 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b Sep 07 10:04:28 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-quobyte-0fcaba08-4d1f-4648-80f0-23893a97f671" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-0fcaba08-4d1f-4648-80f0-23893a97f671" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:28 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db 1073741824" returned: 0 in 0.597s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc603904-fa91-49ec-adda-562e830381ee]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:28 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db Sep 07 10:04:28 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:28 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 Sep 07 10:04:28 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:29 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b" returned: 0 in 0.465s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:29 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b Sep 07 10:04:29 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:29 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db" returned: 0 in 0.313s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4ce84-5c6b-4b42-b497-84daf1579925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fff2b5-d72d-462b-8192-acef0cc254db', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba5d511-0487-4eba-8525-523d963b5bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:29 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Volume volume-04fff2b5-d72d-462b-8192-acef0cc254db (04fff2b5-d72d-462b-8192-acef0cc254db): created successfully Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba5d511-0487-4eba-8525-523d963b5bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Flow 'volume_create_manager' (90f3dadc-96b7-4c3a-8f09-1b20c733a4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4468926e-bd8a-4710-85c7-c5feac624958 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created volume successfully. Sep 07 10:04:29 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671" returned: 0 in 0.459s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:29 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671 Sep 07 10:04:29 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:29 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-3581ae09-cb07-455d-9276-ae36a21e3c1b" returned: 0 in 0.306s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "cinder-quobyte-3581ae09-cb07-455d-9276-ae36a21e3c1b" released by "delete_volume" :: held 0.816s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Created reservations ['34104507-3364-4909-9ac6-5a91906e8875', 'd19b8570-ebf1-47eb-8c2c-5ec136c199ef', '55c69346-7587-4de0-a4ea-10cea4ea52f6', 'ae5ae530-fa72-4632-9f3f-8b7012a31a64'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-04fff2b5-d72d-462b-8192-acef0cc254db-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-04fff2b5-d72d-462b-8192-acef0cc254db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-04fff2b5-d72d-462b-8192-acef0cc254db" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-04fff2b5-d72d-462b-8192-acef0cc254db" acquired by "delete_volume" :: waited 0.043s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:29 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:29 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:29 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-0fcaba08-4d1f-4648-80f0-23893a97f671" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c7bc89-86cc-408e-93ea-fefc15c2a710]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-0fcaba08-4d1f-4648-80f0-23893a97f671" released by "delete_volume" :: held 0.870s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created reservations ['b9177fab-3565-4ce6-aeb0-4c129436271e', 'c0d82d41-0d32-4033-aff4-01a5b0be298a', '6ad54f9c-bb0f-47b5-9c1d-b9d5e7f5413d', '9cdd137f-2416-4a6c-b6fb-39dbf36c52bc'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:29 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db Sep 07 10:04:29 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:30 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.404s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:30 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:30 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Deleted volume successfully. Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-ca38062c-13c8-4db6-8d55-c545c89200f3 tempest-VolumeAndVolumeTypeFromImageTest-1733653690 None] Lock "cinder-3581ae09-cb07-455d-9276-ae36a21e3c1b-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:30 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db" returned: 0 in 0.504s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:30 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db Sep 07 10:04:30 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:30 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.383s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Deleted volume successfully. Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0df6a1c2-a537-41f5-9515-94e6f2e01228 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-0fcaba08-4d1f-4648-80f0-23893a97f671-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:30 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-04fff2b5-d72d-462b-8192-acef0cc254db" returned: 0 in 0.307s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-04fff2b5-d72d-462b-8192-acef0cc254db" released by "delete_volume" :: held 0.865s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created reservations ['423654b1-c720-40fa-ad14-f51d7fa48193', 'a9b68560-d90b-4176-9b5f-2a7e62cadf8f', '12ae3d7c-cd59-488a-becb-6dcff40c0f25', '174a1a2d-deb2-47fa-9c7e-005c3ade8659'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:30 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:30 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-256d5190-a496-4674-b952-ea5a57ef94d0-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-256d5190-a496-4674-b952-ea5a57ef94d0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-256d5190-a496-4674-b952-ea5a57ef94d0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-256d5190-a496-4674-b952-ea5a57ef94d0" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13a86d7-9042-4019-9088-06fde2ca1a31]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:30 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 Sep 07 10:04:31 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:31 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-d93d45ff-5b9a-44b8-a6c1-26a65963ce06-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.391s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:31 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Deleted volume successfully. Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-d93d45ff-5b9a-44b8-a6c1-26a65963ce06-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b3a4d8ca-8986-4b29-92c4-ebab4d4e2ad5 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-04fff2b5-d72d-462b-8192-acef0cc254db-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-quobyte-d93d45ff-5b9a-44b8-a6c1-26a65963ce06" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-d93d45ff-5b9a-44b8-a6c1-26a65963ce06" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed5f207-c20f-4e41-9054-bfe52139bfab]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:31 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0" returned: 0 in 0.478s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:31 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0 Sep 07 10:04:31 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:31 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 Sep 07 10:04:31 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:31 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:31 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-256d5190-a496-4674-b952-ea5a57ef94d0" returned: 0 in 0.323s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-256d5190-a496-4674-b952-ea5a57ef94d0" released by "delete_volume" :: held 0.866s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Created reservations ['a02c3d32-a6ad-48a6-8cfc-3d4cb9be2723', '934c4146-31f5-45d6-b73d-95e786226f75', 'bd5f77c2-4edc-42ad-8063-eff79cb4fa33', '96aafea8-cc79-486d-9e21-7a040c5c65f9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:31 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06 Sep 07 10:04:31 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:32 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:32 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:32 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-d93d45ff-5b9a-44b8-a6c1-26a65963ce06" returned: 0 in 0.385s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-d93d45ff-5b9a-44b8-a6c1-26a65963ce06" released by "delete_volume" :: held 0.877s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created reservations ['ac0db83d-5e7f-43c7-9bbb-9b95c902222d', '3bab055a-a823-456c-acaa-ddc97a769269', '3c9be68d-a29e-42c6-9ff8-4d0bc2656e98', 'c60d88ec-e615-442f-93cc-644bbd56ded7'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:32 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:32 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:32 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.450s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:32 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Deleted volume successfully. Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Flow 'volume_create_manager' (24464ef3-56e0-45fb-9111-9448cbf499f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3002fe35-ddf5-4f77-bc41-af4333cfbf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3002fe35-ddf5-4f77-bc41-af4333cfbf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb187916-699f-47fb-9487-bacfd956485e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ec7b97c10a4216a23bb662b6c57398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:32Z,use_quota=True,user_id='2517fde5e2e64532a004d946192dfc73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547c87a1-f19c-4e97-94b1-1bd1c90f005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547c87a1-f19c-4e97-94b1-1bd1c90f005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f7c801-f600-43ba-9551-46307aef2487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.image.glance [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Creating Keystone auth plugin from conf {{(pid=87290) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bb6686db-cc1e-498b-9f39-43cda386e7fc tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-256d5190-a496-4674-b952-ea5a57ef94d0-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:32 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.319s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:32 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Deleted volume successfully. Sep 07 10:04:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b569e978-7c45-45b0-9107-0b4c16fb1925 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-d93d45ff-5b9a-44b8-a6c1-26a65963ce06-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f7c801-f600-43ba-9551-46307aef2487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb187916-699f-47fb-9487-bacfd956485e', 'volume_name': 'volume-cb187916-699f-47fb-9487-bacfd956485e', 'volume_size': 1, 'image_id': '7d75cf9a-d340-4957-9418-65bb403904f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d75cf9a-d340-4957-9418-65bb403904f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '014e64abeffe3606e93d2586dfc1d22f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30ec7b97c10a4216a23bb662b6c57398', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e2f1eb5a822e845cb014bd69d27ee72868a8b953d013df4a38871d4b7e2f76465b990b2b489ed49807bc2e2938cab773f4313482da4bbec470767b0b7956b81', 'id': '7d75cf9a-d340-4957-9418-65bb403904f5', 'created_at': datetime.datetime(2026, 9, 7, 8, 4, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 4, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d75cf9a-d340-4957-9418-65bb403904f5/file', 'properties': {}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119e37fb-73f3-4c1a-8ede-eda5044f3dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119e37fb-73f3-4c1a-8ede-eda5044f3dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894d8316-c4ce-4ffb-ba40-0aabcb3f54dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:33 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Volume cb187916-699f-47fb-9487-bacfd956485e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb187916-699f-47fb-9487-bacfd956485e', 'volume_size': 1, 'image_id': '7d75cf9a-d340-4957-9418-65bb403904f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d75cf9a-d340-4957-9418-65bb403904f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '014e64abeffe3606e93d2586dfc1d22f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30ec7b97c10a4216a23bb662b6c57398', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e2f1eb5a822e845cb014bd69d27ee72868a8b953d013df4a38871d4b7e2f76465b990b2b489ed49807bc2e2938cab773f4313482da4bbec470767b0b7956b81', 'id': '7d75cf9a-d340-4957-9418-65bb403904f5', 'created_at': datetime.datetime(2026, 9, 7, 8, 4, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 4, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d75cf9a-d340-4957-9418-65bb403904f5/file', 'properties': {}}, 'image_service': } Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Trying to clone cb187916-699f-47fb-9487-bacfd956485e from image 7d75cf9a-d340-4957-9418-65bb403904f5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d75cf9a-d340-4957-9418-65bb403904f5', 'metadata': {}}]). {{(pid=87290) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26c5174-0e98-4ed3-a96f-dd76593dcf27]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:04:33 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Image download 0.00 MB at 0.00 MB/s Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a833b75-8ff5-4b96-a8df-3c982d02883c]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:33 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 Sep 07 10:04:33 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:33 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD Sep 07 10:04:33 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-500f071b-baa9-40f9-9fac-2f095a8bdd9e-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-500f071b-baa9-40f9-9fac-2f095a8bdd9e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-quobyte-500f071b-baa9-40f9-9fac-2f095a8bdd9e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-500f071b-baa9-40f9-9fac-2f095a8bdd9e" acquired by "delete_volume" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f614ea-55b2-4f27-82b8-b82f30a05d6c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:33 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46" returned: 0 in 0.451s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:33 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e Sep 07 10:04:33 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:33 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46 Sep 07 10:04:33 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:33 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:33 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD Sep 07 10:04:33 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:33 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46" returned: 0 in 0.323s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:33 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e" returned: 0 in 0.446s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46" released by "delete_volume" :: held 0.835s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:33 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e Sep 07 10:04:33 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created reservations ['43d03bc7-bac1-4ae1-aec1-da7fc4d3b12b', 'd3ddff06-7fcd-4f5e-b37b-9c7fe579bd5d', '7a6aa090-83ad-4a6d-9c77-be04cabe51c9', 'f2df1707-ca0a-491f-9025-ad1f063c0278'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:34 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:34 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Temporary image 7d75cf9a-d340-4957-9418-65bb403904f5 is fetched for user 2517fde5e2e64532a004d946192dfc73. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-26752331-530f-4544-b734-2bb240453f69-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-26752331-530f-4544-b734-2bb240453f69-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2879161-836b-480c-84a7-b122c8ba20f5]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:34 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-500f071b-baa9-40f9-9fac-2f095a8bdd9e" returned: 0 in 0.414s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-500f071b-baa9-40f9-9fac-2f095a8bdd9e" released by "delete_volume" :: held 0.952s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-26752331-530f-4544-b734-2bb240453f69" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-26752331-530f-4544-b734-2bb240453f69" acquired by "delete_volume" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef10a52c-ad3c-4655-9122-2c9b6b6e59f1]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:34 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:34 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD Sep 07 10:04:34 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.400s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:34 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Deleted volume successfully. Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created reservations ['498f45da-ed78-4f0b-81df-d52ecf41cca1', '67a3bbe4-0b95-4138-ab69-7be2c82eaad9', '4fb11e29-ddff-475f-8d4f-12f94a18f0ba', 'f8c0cab2-4517-45e7-a161-f63a6e359f1c'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-f26acf51-0224-4c11-9c2b-1f0541211a26 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-82cecfad-7e5f-46b6-b3cc-91bcbaf5eb46-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:34 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 Sep 07 10:04:34 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:34 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:34 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:34 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69" returned: 0 in 0.438s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:34 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69 Sep 07 10:04:34 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD Sep 07 10:04:34 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:35 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.325s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Deleted volume successfully. Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48b74985-9039-4f09-9547-8b7d88805a66 tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-500f071b-baa9-40f9-9fac-2f095a8bdd9e-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:35 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb187916-699f-47fb-9487-bacfd956485e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ec7b97c10a4216a23bb662b6c57398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:32Z,use_quota=True,user_id='2517fde5e2e64532a004d946192dfc73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Creating volume cb187916-699f-47fb-9487-bacfd956485e {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:35 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:35 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-26752331-530f-4544-b734-2bb240453f69" returned: 0 in 0.296s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:35 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e 1073741824 Sep 07 10:04:35 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-26752331-530f-4544-b734-2bb240453f69" released by "delete_volume" :: held 0.786s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Created reservations ['fe2258ea-00a3-43bf-a792-8b0b78410a99', '3c57adbb-67f2-44ea-8999-14ae49093bfe', '5b77f129-0c2b-406a-89d4-9a51b6f06050', '0bf766b8-94b5-42b8-9308-1c6bada74ef6'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:35 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:35 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[321ac9e3-f37c-48a5-8a2e-1dafc4c028ad]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-c91507ee-b95b-4296-bfe1-3ab622aa194b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:35 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.386s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-c91507ee-b95b-4296-bfe1-3ab622aa194b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Deleted volume successfully. Sep 07 10:04:35 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 Sep 07 10:04:35 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d4425b62-aa41-4030-84f2-64f1d1b8387d tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-26752331-530f-4544-b734-2bb240453f69-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "cinder-quobyte-c91507ee-b95b-4296-bfe1-3ab622aa194b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:35 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-c91507ee-b95b-4296-bfe1-3ab622aa194b" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e 1073741824" returned: 0 in 0.699s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28f1c5-e1c7-4e9b-ac2a-a83301ee2355]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e Sep 07 10:04:36 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b Sep 07 10:04:36 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Flow 'volume_create_manager' (152a2a79-4872-4d9f-ac7d-d1ac6b214a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee67e776-021c-4125-abb4-e3539b8e9f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586" returned: 0 in 0.582s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee67e776-021c-4125-abb4-e3539b8e9f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10499393-2985-4c82-b61d-edd3f93c1348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17308aba65a54146988891fd5fa73c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:36Z,use_quota=True,user_id='c0c3edb6a1ad46298a0b9eae744865db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:36 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586 Sep 07 10:04:36 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157fbba0-862e-4de4-b2b2-a1e0217fd26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157fbba0-862e-4de4-b2b2-a1e0217fd26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e04dbb4-1905-4275-85bd-d1a58b180478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e04dbb4-1905-4275-85bd-d1a58b180478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10499393-2985-4c82-b61d-edd3f93c1348', 'volume_name': 'volume-10499393-2985-4c82-b61d-edd3f93c1348', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a505fc-0d14-40ca-b671-b1649c5ece1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a505fc-0d14-40ca-b671-b1649c5ece1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa40b60-5a97-4262-87c7-9d9b2b94669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Volume 10499393-2985-4c82-b61d-edd3f93c1348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10499393-2985-4c82-b61d-edd3f93c1348', 'volume_size': 1} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:36 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e" returned: 0 in 0.329s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10499393-2985-4c82-b61d-edd3f93c1348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17308aba65a54146988891fd5fa73c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:36Z,use_quota=True,user_id='c0c3edb6a1ad46298a0b9eae744865db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Creating volume 10499393-2985-4c82-b61d-edd3f93c1348 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:36 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Attempting download of 7d75cf9a-d340-4957-9418-65bb403904f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d75cf9a-d340-4957-9418-65bb403904f5', 'metadata': {}}])) to volume cb187916-699f-47fb-9487-bacfd956485e. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:04:36 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 1073741824 Sep 07 10:04:36 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a2a4f-8a93-438e-8045-30aa22adc816]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d75cf9a-d340-4957-9418-65bb403904f5__5sdcg92 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b" returned: 0 in 0.509s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b Sep 07 10:04:36 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586" returned: 0 in 0.319s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586" released by "delete_volume" :: held 0.958s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:36 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d75cf9a-d340-4957-9418-65bb403904f5__5sdcg92 Sep 07 10:04:36 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created reservations ['aa5fab01-61f9-44be-9701-71a1ec3ce2d2', '608508fb-2b36-44ef-9c0c-8db91f84bd8a', '66a6cb13-745d-4058-858d-01c12ec397a7', '7cb53abf-7294-4d7a-bc2d-888f8ab36bae'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:36 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c91507ee-b95b-4296-bfe1-3ab622aa194b" returned: 0 in 0.346s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-quobyte-c91507ee-b95b-4296-bfe1-3ab622aa194b" released by "delete_volume" :: held 0.922s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Created reservations ['6f5ffee4-22bb-4c76-955b-5eaf0b145aff', 'adb875dc-5b31-469a-8288-dbe0f6fc7791', 'b3cd12d0-e215-4fee-a63e-3f43420e0a28', 'e58e1b35-d68d-4406-a11a-4e50573a41cd'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:36 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d75cf9a-d340-4957-9418-65bb403904f5__5sdcg92" returned: 0 in 0.453s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d75cf9a-d340-4957-9418-65bb403904f5__5sdcg92 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 1073741824" returned: 0 in 0.606s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:37 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:37 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d75cf9a-d340-4957-9418-65bb403904f5__5sdcg92 Sep 07 10:04:37 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:37 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:37 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:37 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 Sep 07 10:04:37 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.355s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Deleted volume successfully. Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-539b4cf7-460a-4387-be2c-412f95124d64 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-2d2fc4d1-bfa5-447a-8b5a-5d6d4f674586-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:37 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d75cf9a-d340-4957-9418-65bb403904f5__5sdcg92" returned: 1 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d75cf9a-d340-4957-9418-65bb403904f5__5sdcg92' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78ebb35-6cd0-4461-b4d0-377a93ee7c42]: (4, 'raw') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:37 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.366s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Deleted volume successfully. Sep 07 10:04:37 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348" returned: 0 in 0.362s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa40b60-5a97-4262-87c7-9d9b2b94669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10499393-2985-4c82-b61d-edd3f93c1348', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceac05e-cae2-440c-80ce-2f645cf032fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-88d8e975-264f-4f50-95c4-b0f32392594e tempest-CreateVolumesFromSourceVolumeTest-973365654 None] Lock "cinder-c91507ee-b95b-4296-bfe1-3ab622aa194b-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:37 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Volume volume-10499393-2985-4c82-b61d-edd3f93c1348 (10499393-2985-4c82-b61d-edd3f93c1348): created successfully Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceac05e-cae2-440c-80ce-2f645cf032fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Flow 'volume_create_manager' (152a2a79-4872-4d9f-ac7d-d1ac6b214a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ec38cbeb-c8dd-4fb3-bc46-4a4ddfc7261d tempest-CinderUnicodeTest-1339752363 None] Created volume successfully. Sep 07 10:04:37 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD Sep 07 10:04:37 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:37 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-cb57234b-22b6-4e5b-85d3-c25c36c77996-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:37 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD Sep 07 10:04:37 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-cb57234b-22b6-4e5b-85d3-c25c36c77996-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-70046963-7263-476e-be4e-3913d8fcdc4c" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-70046963-7263-476e-be4e-3913d8fcdc4c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-cb57234b-22b6-4e5b-85d3-c25c36c77996" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-cb57234b-22b6-4e5b-85d3-c25c36c77996" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Deleting offline snapshot cb57234b-22b6-4e5b-85d3-c25c36c77996 of volume 70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] snapshot_file for this snap is: volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab8844f-1424-4da2-8f24-959eda5b4193]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:38 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 Sep 07 10:04:38 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:38 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] 7d75cf9a-d340-4957-9418-65bb403904f5 was raw, converting to qcow2 {{(pid=87290) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:38 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e Sep 07 10:04:38 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:38 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996" returned: 0 in 0.476s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70046963-7263-476e-be4e-3913d8fcdc4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa33f7a5-be9d-4988-aafe-aa1d58a698b0]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:38 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c Sep 07 10:04:38 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:38 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e" returned: 0 in 0.704s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d75cf9a-d340-4957-9418-65bb403904f5_lf200ssfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:04:38 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:38 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e 1G Sep 07 10:04:38 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:38 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Flow 'volume_create_manager' (5567df14-d44a-4235-9e40-19f429e7482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5029fd1d-4c69-4038-abf7-7332cc14565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5029fd1d-4c69-4038-abf7-7332cc14565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-762653492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23158a9f-2382-4e8e-9ee0-b356c494e865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17308aba65a54146988891fd5fa73c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:39Z,use_quota=True,user_id='c0c3edb6a1ad46298a0b9eae744865db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:39 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48b0f9e-6688-4aa7-8542-63afd374fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48b0f9e-6688-4aa7-8542-63afd374fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b18dd98-3364-4568-97aa-e53495e66019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b18dd98-3364-4568-97aa-e53495e66019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23158a9f-2382-4e8e-9ee0-b356c494e865', 'volume_name': 'volume-23158a9f-2382-4e8e-9ee0-b356c494e865', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa4e10-e640-4475-bc26-ea94bd3317c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa4e10-e640-4475-bc26-ea94bd3317c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2541121f-8bda-4087-bf20-53902d0f796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Volume 23158a9f-2382-4e8e-9ee0-b356c494e865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23158a9f-2382-4e8e-9ee0-b356c494e865', 'volume_size': 1} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-762653492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23158a9f-2382-4e8e-9ee0-b356c494e865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17308aba65a54146988891fd5fa73c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:39Z,use_quota=True,user_id='c0c3edb6a1ad46298a0b9eae744865db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Creating volume 23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:39 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c" returned: 0 in 0.611s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:39 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 1073741824 Sep 07 10:04:39 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:39 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 Sep 07 10:04:39 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:39 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e 1G" returned: 0 in 0.425s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Downloaded image 7d75cf9a-d340-4957-9418-65bb403904f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d75cf9a-d340-4957-9418-65bb403904f5', 'metadata': {}}])) to volume cb187916-699f-47fb-9487-bacfd956485e successfully. {{(pid=87290) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Temporary image 7d75cf9a-d340-4957-9418-65bb403904f5 for user 2517fde5e2e64532a004d946192dfc73 is deleted. {{(pid=87290) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.volume_utils [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Marking volume cb187916-699f-47fb-9487-bacfd956485e as bootable. {{(pid=87290) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Copying metadata from image 7d75cf9a-d340-4957-9418-65bb403904f5 to cb187916-699f-47fb-9487-bacfd956485e. {{(pid=87290) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Creating volume glance metadata for volume cb187916-699f-47fb-9487-bacfd956485e backed by image 7d75cf9a-d340-4957-9418-65bb403904f5 with: {'image_id': '7d75cf9a-d340-4957-9418-65bb403904f5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '014e64abeffe3606e93d2586dfc1d22f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87290) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894d8316-c4ce-4ffb-ba40-0aabcb3f54dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb187916-699f-47fb-9487-bacfd956485e', 'volume_size': 1, 'image_id': '7d75cf9a-d340-4957-9418-65bb403904f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d75cf9a-d340-4957-9418-65bb403904f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '014e64abeffe3606e93d2586dfc1d22f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30ec7b97c10a4216a23bb662b6c57398', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e2f1eb5a822e845cb014bd69d27ee72868a8b953d013df4a38871d4b7e2f76465b990b2b489ed49807bc2e2938cab773f4313482da4bbec470767b0b7956b81', 'id': '7d75cf9a-d340-4957-9418-65bb403904f5', 'created_at': datetime.datetime(2026, 9, 7, 8, 4, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 4, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d75cf9a-d340-4957-9418-65bb403904f5/file', 'properties': {}}, 'image_service': }' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017c2980-486a-4dc9-8a08-358893dcdedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Volume volume-cb187916-699f-47fb-9487-bacfd956485e (cb187916-699f-47fb-9487-bacfd956485e): created successfully Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017c2980-486a-4dc9-8a08-358893dcdedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Flow 'volume_create_manager' (24464ef3-56e0-45fb-9111-9448cbf499f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-74892d78-35b3-4fcb-a6f7-f568f1235ce0 tempest-VolumeImageDependencyTests-998753230 None] Created volume successfully. Sep 07 10:04:39 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996" returned: 0 in 0.451s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:39 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996 Sep 07 10:04:39 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:39 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 1073741824" returned: 0 in 0.532s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:39 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 Sep 07 10:04:39 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:39 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c.cb57234b-22b6-4e5b-85d3-c25c36c77996" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-cb57234b-22b6-4e5b-85d3-c25c36c77996" released by "_delete_snapshot" :: held 1.956s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-70046963-7263-476e-be4e-3913d8fcdc4c" released by "delete_snapshot" :: held 1.994s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:39 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865" returned: 0 in 0.303s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2541121f-8bda-4087-bf20-53902d0f796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23158a9f-2382-4e8e-9ee0-b356c494e865', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62739d03-ac51-466c-838b-840bd8770472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Volume volume-23158a9f-2382-4e8e-9ee0-b356c494e865 (23158a9f-2382-4e8e-9ee0-b356c494e865): created successfully Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62739d03-ac51-466c-838b-840bd8770472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Flow 'volume_create_manager' (5567df14-d44a-4235-9e40-19f429e7482c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Created reservations ['25fdddf5-322c-4c32-863c-654bc9109271', 'ed041f42-5c31-4bff-a61d-fb1fd39d9810', 'c23073f0-f0fd-48f5-81ba-06eb8f0a723e', '9385a677-e592-4954-9a67-c893a2abc793'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b7cdcab6-350a-4b3f-907d-e5293f5c92d8 tempest-CinderUnicodeTest-1339752363 None] Created volume successfully. Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Acquiring lock "cinder-cb187916-699f-47fb-9487-bacfd956485e-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Lock "cinder-cb187916-699f-47fb-9487-bacfd956485e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Delete snapshot completed successfully. Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-a03d4e1a-e7b1-456b-8b01-b0f64af65566 tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-cb57234b-22b6-4e5b-85d3-c25c36c77996-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Acquiring lock "cinder-quobyte-cb187916-699f-47fb-9487-bacfd956485e" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Lock "cinder-quobyte-cb187916-699f-47fb-9487-bacfd956485e" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[924208fd-12c4-4182-8a4d-eb44dd72a3c4]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:40 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e Sep 07 10:04:40 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:40 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Flow 'volume_create_manager' (dab28aa9-d756-42f5-b12f-cffc4a4ceccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d9c119-96c8-4ca3-8e6b-2af4f0861f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:40 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d9c119-96c8-4ca3-8e6b-2af4f0861f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-189178039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a894ea0-c14a-494c-869c-4ba58ea53c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77e6b5b0b1f433bb562275363b3c3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:41Z,use_quota=True,user_id='dba736dd22e84bbaa08a8d59ec4047d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:40 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d1f3ec-1921-4e65-ad3c-e9b48905d705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d1f3ec-1921-4e65-ad3c-e9b48905d705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066ddb64-19a1-4f5f-b7e5-c2efe7e746a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066ddb64-19a1-4f5f-b7e5-c2efe7e746a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a894ea0-c14a-494c-869c-4ba58ea53c4a', 'volume_name': 'volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072f89bc-af5c-4a97-b5e3-761310caf490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072f89bc-af5c-4a97-b5e3-761310caf490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4372cc7c-b6c1-4b60-a858-6bd0b0512de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Volume 1a894ea0-c14a-494c-869c-4ba58ea53c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a', 'volume_size': 1} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-189178039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a894ea0-c14a-494c-869c-4ba58ea53c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77e6b5b0b1f433bb562275363b3c3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:41Z,use_quota=True,user_id='dba736dd22e84bbaa08a8d59ec4047d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Creating volume 1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:40 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:40 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a 1073741824 Sep 07 10:04:40 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:40 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-cb187916-699f-47fb-9487-bacfd956485e" returned: 0 in 0.266s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Lock "cinder-quobyte-cb187916-699f-47fb-9487-bacfd956485e" released by "delete_volume" :: held 0.723s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:40 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Created reservations ['daa87cf7-3b30-40f4-8d18-b2c3619eed1b', 'f4979ed9-19cd-417d-a5fa-4f82127fee32', '12471712-8bd1-464b-a5ce-ce8263489c5c', '277c8f8e-679d-4e12-bce1-3261a305dfa8'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:41 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-70046963-7263-476e-be4e-3913d8fcdc4c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-70046963-7263-476e-be4e-3913d8fcdc4c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:41 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:41 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:41 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "cinder-quobyte-70046963-7263-476e-be4e-3913d8fcdc4c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a 1073741824" returned: 0 in 0.631s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-70046963-7263-476e-be4e-3913d8fcdc4c" acquired by "delete_volume" :: waited 0.041s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:41 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.378s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa907a1-f72e-4bd7-b784-372cd670825d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Deleted volume successfully. Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-296ce735-4606-4400-933f-b457c66a2a23 tempest-VolumeImageDependencyTests-998753230 None] Lock "cinder-cb187916-699f-47fb-9487-bacfd956485e-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a Sep 07 10:04:41 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:41 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c Sep 07 10:04:41 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:41 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.489s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:04:41 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a" returned: 0 in 0.298s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.190s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Creating offline snapshot 13fe88f7-ca34-4e79-94be-7d894298d09d of volume 23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4372cc7c-b6c1-4b60-a858-6bd0b0512de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06bc6c1-e67a-4ade-ab03-58e678d74a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b4a931-ba9f-48cf-bafe-af7076e8b1d2]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:41 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c" returned: 0 in 0.464s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Volume volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a (1a894ea0-c14a-494c-869c-4ba58ea53c4a): created successfully Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06bc6c1-e67a-4ade-ab03-58e678d74a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Flow 'volume_create_manager' (dab28aa9-d756-42f5-b12f-cffc4a4ceccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:41 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c Sep 07 10:04:41 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:41 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d6e9d743-fcfa-46af-8b8e-0ba79631365a tempest-VolumeDependencyTests-166231325 None] Created volume successfully. Sep 07 10:04:42 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 Sep 07 10:04:42 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:42 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-70046963-7263-476e-be4e-3913d8fcdc4c" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-quobyte-70046963-7263-476e-be4e-3913d8fcdc4c" released by "delete_volume" :: held 0.866s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Created reservations ['745bad61-c233-41d5-8064-c77d532a8989', 'eb618e40-73b4-4e00-838b-23af370c6228', '3e93fbf7-a435-4a59-881d-127234468d0b', '6a5d530a-70a6-40db-ad19-319e8db890b8'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:42 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865" returned: 0 in 0.400s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:42 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d 1G Sep 07 10:04:42 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:42 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:42 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:42 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.290s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Deleted volume successfully. Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e358bd4b-3d75-462a-9910-36e43efa8e7e tempest-CreateVolumesFromSnapshotTest-313643088 None] Lock "cinder-70046963-7263-476e-be4e-3913d8fcdc4c-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:42 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d 1G" returned: 0 in 0.521s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23158a9f-2382-4e8e-9ee0-b356c494e865 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:42 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23158a9f-2382-4e8e-9ee0-b356c494e865 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d Sep 07 10:04:42 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:43 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23158a9f-2382-4e8e-9ee0-b356c494e865 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d" returned: 0 in 0.343s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:43 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d is being set with open permissions: ugo+rw Sep 07 10:04:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:43 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d Sep 07 10:04:43 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:43 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d" returned: 0 in 0.283s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:43 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.info Sep 07 10:04:43 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:43 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.info" returned: 0 in 0.281s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:43 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.info is being set with open permissions: ugo+rw Sep 07 10:04:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:43 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.info Sep 07 10:04:43 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:44 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.info" returned: 0 in 0.305s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.151s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Creating offline snapshot 9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe of volume 1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:04:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ef4b4df4-3726-4a16-9ebd-d79e73a7a94f tempest-CinderUnicodeTest-1339752363 None] Create snapshot completed successfully Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd97ca2-3518-4ba6-b3d7-5601119a92b9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:44 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a Sep 07 10:04:44 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:44 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:44 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe 1G Sep 07 10:04:44 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "cinder-13fe88f7-ca34-4e79-94be-7d894298d09d-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-13fe88f7-ca34-4e79-94be-7d894298d09d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "cinder-quobyte-23158a9f-2382-4e8e-9ee0-b356c494e865" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-23158a9f-2382-4e8e-9ee0-b356c494e865" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "cinder-quobyte-13fe88f7-ca34-4e79-94be-7d894298d09d" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-13fe88f7-ca34-4e79-94be-7d894298d09d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Deleting offline snapshot 13fe88f7-ca34-4e79-94be-7d894298d09d of volume 23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] snapshot_file for this snap is: volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbcf45-a71a-4f3d-b7f6-2771e5599e35]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:45 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d Sep 07 10:04:45 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:45 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe 1G" returned: 0 in 0.579s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:45 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe Sep 07 10:04:45 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:45 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d" returned: 0 in 0.448s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23158a9f-2382-4e8e-9ee0-b356c494e865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b76c10b-9e07-4680-99a2-be62eae1af23]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:45 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" returned: 0 in 0.368s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:45 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe is being set with open permissions: ugo+rw Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:45 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 Sep 07 10:04:45 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:45 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe Sep 07 10:04:45 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:45 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:45 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865" returned: 0 in 0.481s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:45 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.info Sep 07 10:04:45 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:45 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d Sep 07 10:04:45 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:46 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.info" returned: 0 in 0.330s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:46 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.info is being set with open permissions: ugo+rw Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:46 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.info Sep 07 10:04:46 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:46 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d" returned: 0 in 0.470s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:46 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d Sep 07 10:04:46 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:46 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.info" returned: 0 in 0.326s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e6a13076-60cb-4fee-8357-892bf966753e tempest-VolumeDependencyTests-166231325 None] Create snapshot completed successfully Sep 07 10:04:46 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865.13fe88f7-ca34-4e79-94be-7d894298d09d" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-13fe88f7-ca34-4e79-94be-7d894298d09d" released by "_delete_snapshot" :: held 1.833s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-23158a9f-2382-4e8e-9ee0-b356c494e865" released by "delete_snapshot" :: held 1.865s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Created reservations ['a253b071-bd89-453d-8392-a8068b808821', 'ec7fc0ec-cc04-4cd7-9b3e-feb40b448a45', '3dfe7872-7c6d-4cee-a1ff-0f3ad9b5d797', '69ef8a9b-cc66-4f3e-835c-b2df23c4156b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Delete snapshot completed successfully. Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c180ae1-c0e5-49dd-8a8d-9f1eb031d4d7 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-13fe88f7-ca34-4e79-94be-7d894298d09d-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "cinder-23158a9f-2382-4e8e-9ee0-b356c494e865-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-23158a9f-2382-4e8e-9ee0-b356c494e865-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "cinder-quobyte-23158a9f-2382-4e8e-9ee0-b356c494e865" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-23158a9f-2382-4e8e-9ee0-b356c494e865" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a973d05-9d17-4e00-9358-c17f42d1e7a8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:47 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 Sep 07 10:04:47 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:47 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865" returned: 0 in 0.454s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:47 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865 Sep 07 10:04:47 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:47 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-23158a9f-2382-4e8e-9ee0-b356c494e865" returned: 0 in 0.313s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-23158a9f-2382-4e8e-9ee0-b356c494e865" released by "delete_volume" :: held 0.886s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:47 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Flow 'volume_create_manager' (c0ff8a0e-a184-4b43-a89d-c949b5a1c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e980a0a6-2dc6-452b-8b6a-6e1fef70e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e980a0a6-2dc6-452b-8b6a-6e1fef70e70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1659854436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c420f07-1577-48b0-9141-15e05a82fa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77e6b5b0b1f433bb562275363b3c3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:48Z,use_quota=True,user_id='dba736dd22e84bbaa08a8d59ec4047d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457fbf63-1f4f-40c4-8101-2f40c738296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457fbf63-1f4f-40c4-8101-2f40c738296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059668b1-0fc3-4a0a-83b0-9bb886b85ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059668b1-0fc3-4a0a-83b0-9bb886b85ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c420f07-1577-48b0-9141-15e05a82fa97', 'volume_name': 'volume-8c420f07-1577-48b0-9141-15e05a82fa97', 'volume_size': 1, 'snapshot_id': '9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c71f9b-7394-4665-b174-f30bff177cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c71f9b-7394-4665-b174-f30bff177cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ead1e7-21da-4201-b5cb-3d6bb1cbf211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:48 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Volume 8c420f07-1577-48b0-9141-15e05a82fa97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c420f07-1577-48b0-9141-15e05a82fa97', 'volume_size': 1, 'snapshot_id': '9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe'} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-quobyte-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe-8c420f07-1577-48b0-9141-15e05a82fa97" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Created reservations ['a168a162-6904-455b-b672-fae875c8edd5', '62f795c5-7d8b-4ba3-9774-0015cd1010e2', 'be29579b-2036-447a-bc8b-1b9770922558', 'fc49b348-a6c8-4ea8-a96c-1ce7369712dd'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe-8c420f07-1577-48b0-9141-15e05a82fa97" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Creating volume 8c420f07-1577-48b0-9141-15e05a82fa97 from snapshot 9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-quobyte-8c420f07-1577-48b0-9141-15e05a82fa97" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-8c420f07-1577-48b0-9141-15e05a82fa97" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] snapshot: 9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe, volume: 8c420f07-1577-48b0-9141-15e05a82fa97, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a80c6-069e-466b-a835-e5f10a0e6947]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:48 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:48 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:48 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe Sep 07 10:04:48 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:48 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.267s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Deleted volume successfully. Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e6bfba70-a507-4193-ad1f-37a01e6b3434 tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-23158a9f-2382-4e8e-9ee0-b356c494e865-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:48 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" returned: 0 in 0.480s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c3ebc6-2995-453c-9788-d307cb23bf95]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:48 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a Sep 07 10:04:48 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:49 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a" returned: 0 in 0.448s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "cinder-10499393-2985-4c82-b61d-edd3f93c1348-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:49 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 Sep 07 10:04:49 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-10499393-2985-4c82-b61d-edd3f93c1348-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "cinder-quobyte-10499393-2985-4c82-b61d-edd3f93c1348" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-10499393-2985-4c82-b61d-edd3f93c1348" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db7c86-e2c6-4b78-b9bf-dadd88370818]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:49 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 Sep 07 10:04:49 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:49 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348" returned: 0 in 0.564s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:50 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348 Sep 07 10:04:50 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:50 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:50 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-10499393-2985-4c82-b61d-edd3f93c1348" returned: 0 in 0.631s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:50 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-quobyte-10499393-2985-4c82-b61d-edd3f93c1348" released by "delete_volume" :: held 1.283s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:50 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Created reservations ['65779d18-2fa9-4a3a-9767-86103e447016', '624ca704-b270-4258-a27e-3a4807901891', 'b92107c4-230e-4469-b7f8-678236204135', 'fbf0f972-a938-425e-9ba7-5383c4255ab3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:51 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:51 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:51 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.723s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:51 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:51 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Deleted volume successfully. Sep 07 10:04:52 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-1a675e63-11d6-4b74-ae0f-97875b1cd32f tempest-CinderUnicodeTest-1339752363 None] Lock "cinder-10499393-2985-4c82-b61d-edd3f93c1348-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:54 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97" returned: 0 in 5.651s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:54 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:04:54 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Converted 1024.00 MB image at 181.16 MB/s Sep 07 10:04:54 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 is being set with open permissions: ugo+rw Sep 07 10:04:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:54 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 Sep 07 10:04:54 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:55 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97" returned: 0 in 0.347s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-8c420f07-1577-48b0-9141-15e05a82fa97" released by "_copy_volume_from_snapshot" :: held 7.052s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe-8c420f07-1577-48b0-9141-15e05a82fa97" released by "_create_volume_from_snapshot" :: held 7.195s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.236s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ead1e7-21da-4201-b5cb-3d6bb1cbf211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c420f07-1577-48b0-9141-15e05a82fa97', 'volume_size': 1, 'snapshot_id': '9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c3b42d-e1de-4e46-945c-2c22523a9eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:55 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Volume volume-8c420f07-1577-48b0-9141-15e05a82fa97 (8c420f07-1577-48b0-9141-15e05a82fa97): created successfully Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c3b42d-e1de-4e46-945c-2c22523a9eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Flow 'volume_create_manager' (c0ff8a0e-a184-4b43-a89d-c949b5a1c901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2c2aef83-07cb-400a-8234-149342b38ccf tempest-VolumeDependencyTests-166231325 None] Created volume successfully. Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Flow 'volume_create_manager' (205232cd-870c-484f-83c3-a411af38eaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f61851a-0a57-430e-a016-01c1bf96fa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f61851a-0a57-430e-a016-01c1bf96fa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071899944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25112b34-d5ed-4473-b1bb-eb5acf0c619c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b209e12ca7d74030982322109c8dcfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:56Z,use_quota=True,user_id='351223bfe8b2401e8f92b6f00fd5b309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7081c09e-3217-4efe-bb6a-473e354985e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7081c09e-3217-4efe-bb6a-473e354985e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75e5451-b7e0-4f3b-bdcd-6ceed936e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75e5451-b7e0-4f3b-bdcd-6ceed936e362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25112b34-d5ed-4473-b1bb-eb5acf0c619c', 'volume_name': 'volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be489521-9f43-43dc-8747-2ad250a387df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be489521-9f43-43dc-8747-2ad250a387df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957008ba-d2f8-4336-a96b-5eaf751fb8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:55 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Volume 25112b34-d5ed-4473-b1bb-eb5acf0c619c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c', 'volume_size': 1} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071899944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25112b34-d5ed-4473-b1bb-eb5acf0c619c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b209e12ca7d74030982322109c8dcfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:56Z,use_quota=True,user_id='351223bfe8b2401e8f92b6f00fd5b309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Creating volume 25112b34-d5ed-4473-b1bb-eb5acf0c619c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:55 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:55 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c 1073741824 Sep 07 10:04:55 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Lock "cinder-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-quobyte-1a894ea0-c14a-494c-869c-4ba58ea53c4a" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-1a894ea0-c14a-494c-869c-4ba58ea53c4a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:55 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-quobyte-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Deleting offline snapshot 9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe of volume 1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] snapshot_file for this snap is: volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed7d40-be9c-42c0-9411-190f911875ee]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:56 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe Sep 07 10:04:56 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:56 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c 1073741824" returned: 0 in 0.625s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:56 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c Sep 07 10:04:56 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:56 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5af964-dd78-4a62-9515-a56be9d535c3]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:56 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a Sep 07 10:04:56 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:56 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c" returned: 0 in 0.305s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957008ba-d2f8-4336-a96b-5eaf751fb8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d2c482-44ff-46c1-85cc-9145bc4270da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:56 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Volume volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c (25112b34-d5ed-4473-b1bb-eb5acf0c619c): created successfully Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d2c482-44ff-46c1-85cc-9145bc4270da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Flow 'volume_create_manager' (205232cd-870c-484f-83c3-a411af38eaba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e962149a-9f26-4cb6-be87-1e087626c466 tempest-ProjectReaderTests-654360280 None] Created volume successfully. Sep 07 10:04:56 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (9d87d438-5ba9-4ad1-be1a-6e44b8ad4abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d7ed4d-b19d-41bb-9a50-b3d02d87e42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d7ed4d-b19d-41bb-9a50-b3d02d87e42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243500819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378d5a99-7b9a-4fd7-aac4-bb542612d739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:57Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca9a3c0-7705-4524-bf76-a8880c281fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca9a3c0-7705-4524-bf76-a8880c281fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2dc1f3-187e-42a8-bbfd-151f557bc85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2dc1f3-187e-42a8-bbfd-151f557bc85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378d5a99-7b9a-4fd7-aac4-bb542612d739', 'volume_name': 'volume-378d5a99-7b9a-4fd7-aac4-bb542612d739', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561f3f1f-2771-4bef-993d-9a7139d68aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561f3f1f-2771-4bef-993d-9a7139d68aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b927430-6f42-4d8c-9dcd-a5dd26e161e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:57 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Volume 378d5a99-7b9a-4fd7-aac4-bb542612d739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378d5a99-7b9a-4fd7-aac4-bb542612d739', 'volume_size': 1} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243500819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378d5a99-7b9a-4fd7-aac4-bb542612d739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:57Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Creating volume 378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:57 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:57 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 1073741824 Sep 07 10:04:57 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:57 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a" returned: 0 in 0.678s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:57 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe Sep 07 10:04:57 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:57 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" returned: 0 in 0.358s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:57 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 1073741824" returned: 0 in 0.457s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:57 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe Sep 07 10:04:57 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:57 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 Sep 07 10:04:57 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:57 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a.9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Acquiring lock "cinder-25112b34-d5ed-4473-b1bb-eb5acf0c619c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe" released by "_delete_snapshot" :: held 1.918s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:57 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Lock "cinder-25112b34-d5ed-4473-b1bb-eb5acf0c619c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739" returned: 0 in 0.311s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-1a894ea0-c14a-494c-869c-4ba58ea53c4a" released by "delete_snapshot" :: held 1.968s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b927430-6f42-4d8c-9dcd-a5dd26e161e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378d5a99-7b9a-4fd7-aac4-bb542612d739', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:57 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d45696-d51f-42ad-9ad3-906b11847d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Acquiring lock "cinder-quobyte-25112b34-d5ed-4473-b1bb-eb5acf0c619c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:58 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Volume volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 (378d5a99-7b9a-4fd7-aac4-bb542612d739): created successfully Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d45696-d51f-42ad-9ad3-906b11847d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (9d87d438-5ba9-4ad1-be1a-6e44b8ad4abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Lock "cinder-quobyte-25112b34-d5ed-4473-b1bb-eb5acf0c619c" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-066c2e54-6d7c-493f-8a2e-3ee8a3cea3f4 tempest-ProjectReaderTests-1280600080 None] Created volume successfully. Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b036ad87-1097-4786-bdf5-7d7a79305751]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Created reservations ['b55fef52-de79-4bf8-b0cc-0ed059f12efa', 'a254e746-d64c-4fd7-a9e7-5e9e820d4ed4', '1a38ddc0-2241-4950-9a4c-1a208d8b10f0', '14c71216-0d26-4afc-acca-9ef255964828'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Delete snapshot completed successfully. Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-160146c6-b7a1-4d9c-a744-a5056b0eed09 tempest-VolumeDependencyTests-166231325 None] Lock "cinder-9d57a6b0-4e0f-47e7-bfc8-e1a372ee83fe-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:58 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c Sep 07 10:04:58 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:58 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c" returned: 0 in 0.377s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:58 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c Sep 07 10:04:58 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:58 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-25112b34-d5ed-4473-b1bb-eb5acf0c619c" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Lock "cinder-quobyte-25112b34-d5ed-4473-b1bb-eb5acf0c619c" released by "delete_volume" :: held 0.696s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Created reservations ['90949f98-3846-4640-b307-97a15388ccf5', 'f18d18fe-b20e-4087-9553-25033673aced', 'ef07367d-125f-4d58-a8d9-9650b96bbd79', '44ea12a3-9474-49d9-ab38-7f40781b2a6a'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:58 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:04:58 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:59 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.268s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Deleted volume successfully. Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-00e263a8-4ae4-435f-804e-0e37fafeea92 tempest-ProjectReaderTests-654360280 None] Lock "cinder-25112b34-d5ed-4473-b1bb-eb5acf0c619c-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-1a894ea0-c14a-494c-869c-4ba58ea53c4a-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Lock "cinder-1a894ea0-c14a-494c-869c-4ba58ea53c4a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-quobyte-1a894ea0-c14a-494c-869c-4ba58ea53c4a" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-1a894ea0-c14a-494c-869c-4ba58ea53c4a" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d2af4f-11d2-4661-851c-9f8cd5df6c5d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Creating offline snapshot 9fde9939-cee1-4c10-a214-c6993a8fa9e1 of volume 378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[95909dba-55fa-42db-a77b-76960d4b4364]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:59 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a Sep 07 10:04:59 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:59 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 Sep 07 10:04:59 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Flow 'volume_create_manager' (dcb4290d-f524-4016-bdd6-3b5a1a0c9b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d69024-f321-4a60-949e-6dba5a901ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d69024-f321-4a60-949e-6dba5a901ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133528810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bea8a52-6b59-44e4-b7cf-467430725ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b209e12ca7d74030982322109c8dcfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:00Z,use_quota=True,user_id='351223bfe8b2401e8f92b6f00fd5b309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffea44f-725e-4410-b037-41e512bde6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffea44f-725e-4410-b037-41e512bde6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f57355-439d-42b0-afc7-069e89045229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f57355-439d-42b0-afc7-069e89045229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bea8a52-6b59-44e4-b7cf-467430725ed0', 'volume_name': 'volume-7bea8a52-6b59-44e4-b7cf-467430725ed0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d2bbce-f03e-456d-878b-12a8eb881913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d2bbce-f03e-456d-878b-12a8eb881913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473044e6-4f0d-462b-b5ad-284122fc303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:59 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Volume 7bea8a52-6b59-44e4-b7cf-467430725ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bea8a52-6b59-44e4-b7cf-467430725ed0', 'volume_size': 1} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:59 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a" returned: 0 in 0.436s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:00 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a Sep 07 10:05:00 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:00 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739" returned: 0 in 0.382s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:00 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 1G Sep 07 10:05:00 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:00 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1a894ea0-c14a-494c-869c-4ba58ea53c4a" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-1a894ea0-c14a-494c-869c-4ba58ea53c4a" released by "delete_volume" :: held 0.764s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Created reservations ['586dc05c-9cd4-4a76-bf5f-1a22b8df0dae', 'f9239a01-72db-464d-844d-65e91fcd4f3c', '30be0d61-1c51-4a43-9fdf-1c737cacb927', 'b4255118-f397-469d-a52a-bf40017bbd30'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:00 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:00 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:00 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 1G" returned: 0 in 0.482s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:00 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 Sep 07 10:05:00 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-8c420f07-1577-48b0-9141-15e05a82fa97-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Lock "cinder-8c420f07-1577-48b0-9141-15e05a82fa97-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:00 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.337s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:00 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Deleted volume successfully. Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Acquiring lock "cinder-quobyte-8c420f07-1577-48b0-9141-15e05a82fa97" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-8c420f07-1577-48b0-9141-15e05a82fa97" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4089a9e3-bacd-4a3b-905c-8ed1b2c7d54d tempest-VolumeDependencyTests-166231325 None] Lock "cinder-1a894ea0-c14a-494c-869c-4ba58ea53c4a-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c85267-757b-467e-a3e8-d0447bd74185]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:00 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1" returned: 0 in 0.421s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:00 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 is being set with open permissions: ugo+rw Sep 07 10:05:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:00 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 Sep 07 10:05:00 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:00 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 Sep 07 10:05:00 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:01 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1" returned: 0 in 0.304s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:01 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97" returned: 0 in 0.425s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:01 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97 Sep 07 10:05:01 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:01 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.info Sep 07 10:05:01 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:01 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8c420f07-1577-48b0-9141-15e05a82fa97" returned: 0 in 0.311s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Lock "cinder-quobyte-8c420f07-1577-48b0-9141-15e05a82fa97" released by "delete_volume" :: held 0.809s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:01 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.info" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:01 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.info is being set with open permissions: ugo+rw Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:01 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.info Sep 07 10:05:01 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Created reservations ['5b26a99d-2111-4c02-90bf-428be0e6ee06', '6935ac06-f731-4c26-b823-4c9c8bf6603c', '58fd14d8-9979-484a-aac1-e77c8468be31', 'c3b5aa76-83d0-4e2d-99b9-c2a79c50bf55'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:01 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:01 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:01 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.info" returned: 0 in 0.288s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133528810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bea8a52-6b59-44e4-b7cf-467430725ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b209e12ca7d74030982322109c8dcfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:00Z,use_quota=True,user_id='351223bfe8b2401e8f92b6f00fd5b309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Creating volume 7bea8a52-6b59-44e4-b7cf-467430725ed0 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:01 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:01 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 1073741824 Sep 07 10:05:01 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:01 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-65031864-c65d-4238-94c1-27ea8c0ed5f0 tempest-ProjectReaderTests-1280600080 None] Create snapshot completed successfully Sep 07 10:05:02 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.277s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Deleted volume successfully. Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-288953bd-acda-48f2-8b2d-b5599c63b6ea tempest-VolumeDependencyTests-166231325 None] Lock "cinder-8c420f07-1577-48b0-9141-15e05a82fa97-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:02 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 1073741824" returned: 0 in 0.511s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:02 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 Sep 07 10:05:02 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-9fde9939-cee1-4c10-a214-c6993a8fa9e1-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Lock "cinder-9fde9939-cee1-4c10-a214-c6993a8fa9e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-378d5a99-7b9a-4fd7-aac4-bb542612d739" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-378d5a99-7b9a-4fd7-aac4-bb542612d739" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-9fde9939-cee1-4c10-a214-c6993a8fa9e1" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-9fde9939-cee1-4c10-a214-c6993a8fa9e1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Deleting offline snapshot 9fde9939-cee1-4c10-a214-c6993a8fa9e1 of volume 378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] snapshot_file for this snap is: volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[816546fe-37ac-4bd0-a706-09b2570e3bb9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:03 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0" returned: 0 in 0.428s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473044e6-4f0d-462b-b5ad-284122fc303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bea8a52-6b59-44e4-b7cf-467430725ed0', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80dfa8d-2190-4401-9ad0-5c512ab41ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Volume volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 (7bea8a52-6b59-44e4-b7cf-467430725ed0): created successfully Sep 07 10:05:03 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80dfa8d-2190-4401-9ad0-5c512ab41ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:03 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Flow 'volume_create_manager' (dcb4290d-f524-4016-bdd6-3b5a1a0c9b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:03 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f28358c1-cbe1-404a-82ea-e4d78e50641c tempest-ProjectReaderTests-654360280 None] Created volume successfully. Sep 07 10:05:03 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1" returned: 0 in 0.449s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-378d5a99-7b9a-4fd7-aac4-bb542612d739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[36aeb0fb-f18c-4e48-b79a-e20d16f08e28]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:03 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 Sep 07 10:05:03 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:03 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739" returned: 0 in 0.402s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:03 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 Sep 07 10:05:03 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Acquiring lock "cinder-7bea8a52-6b59-44e4-b7cf-467430725ed0-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Lock "cinder-7bea8a52-6b59-44e4-b7cf-467430725ed0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Acquiring lock "cinder-quobyte-7bea8a52-6b59-44e4-b7cf-467430725ed0" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Lock "cinder-quobyte-7bea8a52-6b59-44e4-b7cf-467430725ed0" acquired by "delete_volume" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:04 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1" returned: 0 in 0.535s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12d36e-2980-454a-a5de-087cdec76960]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:04 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1 Sep 07 10:05:04 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:04 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 Sep 07 10:05:04 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:04 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739.9fde9939-cee1-4c10-a214-c6993a8fa9e1" returned: 0 in 0.346s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-9fde9939-cee1-4c10-a214-c6993a8fa9e1" released by "_delete_snapshot" :: held 1.892s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-378d5a99-7b9a-4fd7-aac4-bb542612d739" released by "delete_snapshot" :: held 1.928s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:04 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Created reservations ['c31c9447-5004-4cd7-a19e-00d0b4140544', 'd19f9e40-2325-4611-b6a3-80862ee7bf7e', '43b713b6-76ae-4827-b93e-c97380a1dcae', '122e5a77-710d-4e3a-9077-192e88be721b'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0" returned: 0 in 0.491s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:04 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0 Sep 07 10:05:04 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Delete snapshot completed successfully. Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4a01f4df-5e77-47cb-8437-2f7914fefeac tempest-ProjectReaderTests-1280600080 None] Lock "cinder-9fde9939-cee1-4c10-a214-c6993a8fa9e1-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:05 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7bea8a52-6b59-44e4-b7cf-467430725ed0" returned: 0 in 0.317s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Lock "cinder-quobyte-7bea8a52-6b59-44e4-b7cf-467430725ed0" released by "delete_volume" :: held 0.877s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Created reservations ['01eac1d4-b2b4-4ab3-8707-1b2cb59c9202', '7ddbf4e2-a106-437a-8b9f-e1d05e475498', '0a683a2a-56fa-41cf-b3db-c972ca0bc80b', '174bcc75-49dc-4742-b9a3-1dfeaf818e3f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:05 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:05 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:05 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.249s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Deleted volume successfully. Sep 07 10:05:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0a46501a-bff8-4584-9f15-e7db7c3a4043 tempest-ProjectReaderTests-654360280 None] Lock "cinder-7bea8a52-6b59-44e4-b7cf-467430725ed0-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-e8aa0e68-4ab2-4e96-8d8b-6f05d8769886 tempest-ProjectAdminTests-1844299227 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6140975952148, 'free_capacity_gb': 1773.6140975952148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87290) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-378d5a99-7b9a-4fd7-aac4-bb542612d739-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-378d5a99-7b9a-4fd7-aac4-bb542612d739-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-378d5a99-7b9a-4fd7-aac4-bb542612d739" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-378d5a99-7b9a-4fd7-aac4-bb542612d739" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b49ec20-ae6d-482d-a682-72c29c768f6e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:06 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 Sep 07 10:05:06 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:06 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739" returned: 0 in 0.422s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:06 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739 Sep 07 10:05:06 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:06 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-378d5a99-7b9a-4fd7-aac4-bb542612d739" returned: 0 in 0.267s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-378d5a99-7b9a-4fd7-aac4-bb542612d739" released by "delete_volume" :: held 0.753s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:06 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Created reservations ['f1e9df43-64e6-4a22-ba42-7a41c1bf6989', 'b231b55d-ccc7-4e89-942d-09167dc16717', '111b4120-9070-4158-9e85-c76cf1dd6945', '8f232129-83f6-4074-98b4-3a665f71f670'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:07 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:07 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:07 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.358s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:07 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Deleted volume successfully. Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-cb92680c-5d31-4410-8b43-6efe39f274a4 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-378d5a99-7b9a-4fd7-aac4-bb542612d739-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=341,cinder:SELECT=216,cinder:INSERT=88,cinder:DELETE=30 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=244,cinder:UPDATE=295,cinder:INSERT=81,cinder:DELETE=26 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:07 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (dcebc770-dec2-434f-856e-5db5c9f67b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda96801-232d-4b59-b950-1aa95f6c008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda96801-232d-4b59-b950-1aa95f6c008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107956036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abda79d-a4f9-4889-ad2e-6ab14015c0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:08Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a6a9f8-a7fd-45f5-bc27-608f11ba7b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a6a9f8-a7fd-45f5-bc27-608f11ba7b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eaa445-0305-4e46-a044-3168e52a78af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eaa445-0305-4e46-a044-3168e52a78af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abda79d-a4f9-4889-ad2e-6ab14015c0e3', 'volume_name': 'volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93aed1c-bd8d-447c-9e4f-d1209cb6a007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93aed1c-bd8d-447c-9e4f-d1209cb6a007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa52e8b-ce07-412b-82cb-6be03e6c1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Volume 7abda79d-a4f9-4889-ad2e-6ab14015c0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3', 'volume_size': 1} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107956036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abda79d-a4f9-4889-ad2e-6ab14015c0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:08Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Creating volume 7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:08 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:08 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 1073741824 Sep 07 10:05:08 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:08 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 1073741824" returned: 0 in 0.570s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:08 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 Sep 07 10:05:08 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:08 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" returned: 0 in 0.289s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa52e8b-ce07-412b-82cb-6be03e6c1b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842bfb9c-a9c7-4ad2-aee7-2957c2cbfe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:09 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Volume volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 (7abda79d-a4f9-4889-ad2e-6ab14015c0e3): created successfully Sep 07 10:05:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842bfb9c-a9c7-4ad2-aee7-2957c2cbfe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:09 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (dcebc770-dec2-434f-856e-5db5c9f67b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:09 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1fd6850b-ac1c-454f-b914-84b4bd0432a7 tempest-ProjectReaderTests-1280600080 None] Created volume successfully. Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Creating offline snapshot 0224bcc5-b928-457e-9299-25dce51a47f9 of volume 7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc999fc-b10e-45d8-a492-b0e2ca8b4c60]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:10 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 Sep 07 10:05:10 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:10 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" returned: 0 in 0.381s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:10 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 1G Sep 07 10:05:10 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (9fdac332-6129-487e-93ce-19ae12b35dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:10 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6ca8f8-03b9-4f01-b173-5eb6a8ac0e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 1G" returned: 0 in 0.401s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:10 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6ca8f8-03b9-4f01-b173-5eb6a8ac0e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484157911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:11Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:10 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f130779-784e-42c2-9699-7791e7f15429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f130779-784e-42c2-9699-7791e7f15429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47751e8-697d-49fe-94c1-a3409af7fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:10 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47751e8-697d-49fe-94c1-a3409af7fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c', 'volume_name': 'volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb3d505-65cb-4a28-9a63-133357116ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb3d505-65cb-4a28-9a63-133357116ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c103b009-0c65-4c53-9bf6-ab2b7e6311ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Volume 1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c', 'volume_size': 1} Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:11 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9" returned: 0 in 0.280s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:11 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 is being set with open permissions: ugo+rw Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:11 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 Sep 07 10:05:11 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:11 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:11 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.info Sep 07 10:05:11 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:11 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.info" returned: 0 in 0.247s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:11 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.info is being set with open permissions: ugo+rw Sep 07 10:05:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:11 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.info Sep 07 10:05:11 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:11 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.info" returned: 0 in 0.252s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484157911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:11Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Creating volume 1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:12 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:12 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c 1073741824 Sep 07 10:05:12 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-99db1606-b6e0-45d3-9d5d-7ebb562f10ce tempest-ProjectReaderTests-1280600080 None] Create snapshot completed successfully Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-0224bcc5-b928-457e-9299-25dce51a47f9-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-0224bcc5-b928-457e-9299-25dce51a47f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-0224bcc5-b928-457e-9299-25dce51a47f9" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-0224bcc5-b928-457e-9299-25dce51a47f9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Deleting offline snapshot 0224bcc5-b928-457e-9299-25dce51a47f9 of volume 7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] snapshot_file for this snap is: volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b17185-aec0-43c7-b14a-f318e82f6eb4]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:12 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 Sep 07 10:05:12 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:12 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c 1073741824" returned: 0 in 0.456s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:12 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c Sep 07 10:05:12 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:12 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9" returned: 0 in 0.398s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:12 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a2f83d-267c-49ed-8bd6-30e35ee3d4a9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c103b009-0c65-4c53-9bf6-ab2b7e6311ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b506fea-3d71-47da-af11-bfa463a3a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Volume volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c (1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c): created successfully Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b506fea-3d71-47da-af11-bfa463a3a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (9fdac332-6129-487e-93ce-19ae12b35dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-ec837f16-cf24-46bb-b960-4a21a6072d9d tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:05:12 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 Sep 07 10:05:12 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:13 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" returned: 0 in 0.368s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:13 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 Sep 07 10:05:13 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Creating offline snapshot 6184b595-6c05-4692-b523-7dd1f72f5e99 of volume 1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd65d42-e949-47ee-ae66-cb45b46f5d3b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:13 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c Sep 07 10:05:13 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:13 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9" returned: 0 in 0.383s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:13 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9 Sep 07 10:05:13 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:13 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:13 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 1G Sep 07 10:05:13 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:13 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3.0224bcc5-b928-457e-9299-25dce51a47f9" returned: 0 in 0.286s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-0224bcc5-b928-457e-9299-25dce51a47f9" released by "_delete_snapshot" :: held 1.540s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" released by "delete_snapshot" :: held 1.565s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:13 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Created reservations ['e531ffa7-a10c-48c9-94a3-122145b95a95', '5bb50166-225e-4859-994b-757fd6076198', 'df1832c2-031f-4a02-9991-59d3fe8b4595', '68a3bc33-9860-435e-8ae7-e54255ad577e'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Delete snapshot completed successfully. Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8d20f9dd-ef03-4823-acd8-7841c17bc2b1 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-0224bcc5-b928-457e-9299-25dce51a47f9-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:14 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 1G" returned: 0 in 0.452s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:14 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 Sep 07 10:05:14 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-7abda79d-a4f9-4889-ad2e-6ab14015c0e3-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-7abda79d-a4f9-4889-ad2e-6ab14015c0e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:14 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99" returned: 0 in 0.368s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:14 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 is being set with open permissions: ugo+rw Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fcada6-7657-4cf1-a0ba-fb61b1953588]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:14 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 Sep 07 10:05:14 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:14 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 Sep 07 10:05:14 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:14 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99" returned: 0 in 0.277s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:14 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.info Sep 07 10:05:14 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:15 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" returned: 0 in 0.445s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:15 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3 Sep 07 10:05:15 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:15 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.info" returned: 0 in 0.286s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:15 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.info is being set with open permissions: ugo+rw Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:15 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.info Sep 07 10:05:15 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:15 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" returned: 0 in 0.349s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-7abda79d-a4f9-4889-ad2e-6ab14015c0e3" released by "delete_volume" :: held 0.873s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Created reservations ['f3947047-da36-4d55-a0c4-e28f41bb710a', '0b5e6778-f54e-4b76-a16a-bed8ce8f7b30', '674d050e-92ec-40c2-9f4c-ae469747a452', '1f75458b-9c6b-4973-baad-9747724ebbf2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:15 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.info" returned: 0 in 0.337s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-75b46318-0615-41cb-ab8b-4a13a0f5cecf tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:05:15 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:15 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:15 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.261s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Deleted volume successfully. Sep 07 10:05:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6c90cfc8-31ee-4a4d-91da-4b1be4d25a63 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-7abda79d-a4f9-4889-ad2e-6ab14015c0e3-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (69601cfd-7298-4d05-bdda-bc3f6fecdd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b633ff28-5999-43d0-b39f-ad8bb71ead95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b633ff28-5999-43d0-b39f-ad8bb71ead95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1076258457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff849e7-026c-4f95-a291-25a21e3739a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:16Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faa0c9e-a893-45ba-8d7b-e446d1694f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faa0c9e-a893-45ba-8d7b-e446d1694f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca21e1ef-7c7a-41b3-b886-eb29b56466fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca21e1ef-7c7a-41b3-b886-eb29b56466fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff849e7-026c-4f95-a291-25a21e3739a7', 'volume_name': 'volume-bff849e7-026c-4f95-a291-25a21e3739a7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d33a80-4f27-4222-8a2a-3870119b097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d33a80-4f27-4222-8a2a-3870119b097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd73967-7c14-4c30-879f-942de47d6887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Volume bff849e7-026c-4f95-a291-25a21e3739a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff849e7-026c-4f95-a291-25a21e3739a7', 'volume_size': 1} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1076258457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff849e7-026c-4f95-a291-25a21e3739a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:16Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Creating volume bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:16 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:16 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 1073741824 Sep 07 10:05:16 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-6184b595-6c05-4692-b523-7dd1f72f5e99-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Lock "cinder-6184b595-6c05-4692-b523-7dd1f72f5e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-6184b595-6c05-4692-b523-7dd1f72f5e99" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-6184b595-6c05-4692-b523-7dd1f72f5e99" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot 6184b595-6c05-4692-b523-7dd1f72f5e99 of volume 1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68821c5-5dea-49ae-b942-2bd30de1e9eb]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:16 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 1073741824" returned: 0 in 0.489s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:16 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 Sep 07 10:05:16 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:16 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 Sep 07 10:05:16 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:17 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7" returned: 0 in 0.299s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd73967-7c14-4c30-879f-942de47d6887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff849e7-026c-4f95-a291-25a21e3739a7', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629ece7b-b10c-4707-aca6-12c0bd42d3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:17 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99" returned: 0 in 0.463s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:17 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Volume volume-bff849e7-026c-4f95-a291-25a21e3739a7 (bff849e7-026c-4f95-a291-25a21e3739a7): created successfully Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629ece7b-b10c-4707-aca6-12c0bd42d3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (69601cfd-7298-4d05-bdda-bc3f6fecdd87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49fd8c-005f-4335-9247-f425b0f199a8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:17 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-db6b5ad9-d3bf-4ce6-9099-50e38e7feb06 tempest-ProjectReaderTests-1280600080 None] Created volume successfully. Sep 07 10:05:17 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c Sep 07 10:05:17 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:17 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" returned: 0 in 0.381s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:17 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 Sep 07 10:05:17 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:17 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99" returned: 0 in 0.399s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:17 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99 Sep 07 10:05:17 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:18 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c.6184b595-6c05-4692-b523-7dd1f72f5e99" returned: 0 in 0.297s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-6184b595-6c05-4692-b523-7dd1f72f5e99" released by "_delete_snapshot" :: held 1.683s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" released by "delete_snapshot" :: held 1.707s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Created reservations ['e2200d15-3278-470f-96f1-da4c4ff954a2', '3e9e5983-9b94-4a76-b2b4-c5643dbc5135', '00c595f8-7565-41f9-8a08-8f149fbf3070', 'd557b6a5-241f-42c3-9268-4987b6d828b9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Creating offline snapshot 79380226-d1c6-44d3-9b69-410a9e67f8e4 of volume bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[093196fc-d7f5-40a6-9657-0fcbc9a76771]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3a73d5e3-1dc9-46a9-a237-1ad755ce4da5 tempest-ProjectMemberTests-542438711 None] Lock "cinder-6184b595-6c05-4692-b523-7dd1f72f5e99-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:18 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 Sep 07 10:05:18 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Lock "cinder-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" acquired by "delete_volume" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f34fb65-ca99-44b0-be0d-ed53f715c17d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:18 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7" returned: 0 in 0.426s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:18 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 1G Sep 07 10:05:18 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c Sep 07 10:05:19 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:19 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c Sep 07 10:05:19 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 1G" returned: 0 in 0.550s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff849e7-026c-4f95-a291-25a21e3739a7 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:19 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff849e7-026c-4f95-a291-25a21e3739a7 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 Sep 07 10:05:19 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" returned: 0 in 0.273s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c" released by "delete_volume" :: held 0.758s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Created reservations ['91038893-d47e-4cf6-9cda-60286e230712', '9a2f1447-6716-42dc-ac41-3d1c60a6d49c', '4e529044-bc04-4d74-b8bf-012096ec185a', 'cbc560e3-791c-460e-b742-f3e6a53240cb'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:19 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:19 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff849e7-026c-4f95-a291-25a21e3739a7 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4" returned: 0 in 0.345s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:19 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 is being set with open permissions: ugo+rw Sep 07 10:05:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:19 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 Sep 07 10:05:19 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:20 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-da2f35f6-48e4-410b-b686-c5de5f4f9feb tempest-ProjectMemberTests-542438711 None] Lock "cinder-1f4ec6c2-0cc2-4a7d-b90c-5b898a6fda3c-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:20 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4" returned: 0 in 0.303s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:20 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.info Sep 07 10:05:20 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:20 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (245319f0-d8e3-4d90-9779-98d73a24e4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f856bd-559f-4fa4-a811-a600e7d45a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.info" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:20 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.info is being set with open permissions: ugo+rw Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f856bd-559f-4fa4-a811-a600e7d45a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299492665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee477b0f-7895-49be-8601-2304ab5763c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:20Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:20 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.info Sep 07 10:05:20 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5149f18f-24ef-48c2-813a-7e0f37786a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5149f18f-24ef-48c2-813a-7e0f37786a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d282adb-9bd1-466f-9359-03bcfbd269e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d282adb-9bd1-466f-9359-03bcfbd269e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee477b0f-7895-49be-8601-2304ab5763c3', 'volume_name': 'volume-ee477b0f-7895-49be-8601-2304ab5763c3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351cd69-fe3b-4ea9-a92b-3eee18f39a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351cd69-fe3b-4ea9-a92b-3eee18f39a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d4c733-7ddb-4537-a25c-580fb8d6b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:20 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Volume ee477b0f-7895-49be-8601-2304ab5763c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee477b0f-7895-49be-8601-2304ab5763c3', 'volume_size': 1} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:20 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.info" returned: 0 in 0.251s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.208s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299492665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee477b0f-7895-49be-8601-2304ab5763c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:20Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Creating volume ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:20 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:20 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 1073741824 Sep 07 10:05:20 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d409a12f-cee1-4869-b55e-018917e2780a tempest-ProjectReaderTests-1280600080 None] Create snapshot completed successfully Sep 07 10:05:21 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 1073741824" returned: 0 in 0.424s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:21 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 Sep 07 10:05:21 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:21 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3" returned: 0 in 0.308s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d4c733-7ddb-4537-a25c-580fb8d6b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee477b0f-7895-49be-8601-2304ab5763c3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481bbcf3-b8b3-46a3-993e-c65ce304c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-79380226-d1c6-44d3-9b69-410a9e67f8e4-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Volume volume-ee477b0f-7895-49be-8601-2304ab5763c3 (ee477b0f-7895-49be-8601-2304ab5763c3): created successfully Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481bbcf3-b8b3-46a3-993e-c65ce304c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (245319f0-d8e3-4d90-9779-98d73a24e4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-afc3e998-4d94-43e6-b1f6-ebb2de30e475 tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Lock "cinder-79380226-d1c6-44d3-9b69-410a9e67f8e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-bff849e7-026c-4f95-a291-25a21e3739a7" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-bff849e7-026c-4f95-a291-25a21e3739a7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-79380226-d1c6-44d3-9b69-410a9e67f8e4" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-79380226-d1c6-44d3-9b69-410a9e67f8e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Deleting offline snapshot 79380226-d1c6-44d3-9b69-410a9e67f8e4 of volume bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] snapshot_file for this snap is: volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[934f3fbb-e277-40cf-917d-4ffbca865e86]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:21 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 Sep 07 10:05:21 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:22 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4" returned: 0 in 0.385s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bff849e7-026c-4f95-a291-25a21e3739a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[785adce4-5db5-44b9-a9df-0f3a58fc07e9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:22 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 Sep 07 10:05:22 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:22 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7" returned: 0 in 0.470s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:22 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 Sep 07 10:05:22 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Creating offline snapshot 1ef9f180-8fab-4d89-8eed-d06bb43697e9 of volume ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a5af14-6a05-43bd-b7e3-24eb67c97cd6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:23 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 Sep 07 10:05:23 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:23 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4" returned: 0 in 0.525s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:23 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4 Sep 07 10:05:23 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:23 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3" returned: 0 in 0.491s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:23 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7.79380226-d1c6-44d3-9b69-410a9e67f8e4" returned: 0 in 0.297s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:23 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 1G Sep 07 10:05:23 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-79380226-d1c6-44d3-9b69-410a9e67f8e4" released by "_delete_snapshot" :: held 1.809s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-bff849e7-026c-4f95-a291-25a21e3739a7" released by "delete_snapshot" :: held 1.839s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Created reservations ['6d2c9bb8-746a-498f-89be-00db1145302b', 'df254d3c-a1e3-4a03-9811-a70525b94115', 'd7920ebb-a93b-4b5c-8679-3ef83e28f2d0', 'ca37f974-36d0-47ac-81d7-b96fa24df711'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Delete snapshot completed successfully. Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d6ca5c02-44a8-4df4-8585-e34fe6f8d38a tempest-ProjectReaderTests-1280600080 None] Lock "cinder-79380226-d1c6-44d3-9b69-410a9e67f8e4-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-bff849e7-026c-4f95-a291-25a21e3739a7-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:23 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Lock "cinder-bff849e7-026c-4f95-a291-25a21e3739a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-bff849e7-026c-4f95-a291-25a21e3739a7" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-bff849e7-026c-4f95-a291-25a21e3739a7" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a6a55-8f3f-4f89-b05a-74018297838f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:24 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 1G" returned: 0 in 0.598s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee477b0f-7895-49be-8601-2304ab5763c3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:24 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee477b0f-7895-49be-8601-2304ab5763c3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 Sep 07 10:05:24 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 Sep 07 10:05:24 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee477b0f-7895-49be-8601-2304ab5763c3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9" returned: 0 in 0.349s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:24 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 is being set with open permissions: ugo+rw Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:24 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:24 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 Sep 07 10:05:24 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7 Sep 07 10:05:24 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9" returned: 0 in 0.269s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:24 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.info Sep 07 10:05:24 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bff849e7-026c-4f95-a291-25a21e3739a7" returned: 0 in 0.317s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-bff849e7-026c-4f95-a291-25a21e3739a7" released by "delete_volume" :: held 0.814s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Created reservations ['fbba8544-2de8-4b62-be3d-14074cabb221', '5e6c5cef-f608-4215-a1f1-6002dab17e6f', 'c84f9fd9-00ba-45ac-b3c5-cc309c56a31c', '3401f898-0023-43ba-b8be-711c27ba8d0c'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:25 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:25 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:25 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.info" returned: 0 in 0.301s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:25 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.info is being set with open permissions: ugo+rw Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:25 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.info Sep 07 10:05:25 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:25 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.283s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Deleted volume successfully. Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-803e250c-2b38-41c9-89fb-fa0fd411a65e tempest-ProjectReaderTests-1280600080 None] Lock "cinder-bff849e7-026c-4f95-a291-25a21e3739a7-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:25 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.info" returned: 0 in 0.383s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-1f8e66d7-63c2-4f91-89dd-63c6ed07da11 tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (fc74bfa2-e03f-4961-ae49-5dbf59387223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cd7742-b73e-482c-814c-c1d08a8e758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cd7742-b73e-482c-814c-c1d08a8e758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738466872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f4da39-0964-4da3-9508-f882676d2127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:26Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd19e40-7026-4cc0-a62e-8ae2a4bf472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd19e40-7026-4cc0-a62e-8ae2a4bf472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6df646-a716-4fbc-b7d0-a3b4931960eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6df646-a716-4fbc-b7d0-a3b4931960eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f4da39-0964-4da3-9508-f882676d2127', 'volume_name': 'volume-62f4da39-0964-4da3-9508-f882676d2127', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7465b11d-9797-479d-b732-8eb1960503b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7465b11d-9797-479d-b732-8eb1960503b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4860231d-9daf-4c8e-b693-14727b122197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:25 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Volume 62f4da39-0964-4da3-9508-f882676d2127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f4da39-0964-4da3-9508-f882676d2127', 'volume_size': 1} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738466872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f4da39-0964-4da3-9508-f882676d2127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:26Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Creating volume 62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:25 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:25 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 1073741824 Sep 07 10:05:25 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-1ef9f180-8fab-4d89-8eed-d06bb43697e9-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Lock "cinder-1ef9f180-8fab-4d89-8eed-d06bb43697e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-ee477b0f-7895-49be-8601-2304ab5763c3" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ee477b0f-7895-49be-8601-2304ab5763c3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-1ef9f180-8fab-4d89-8eed-d06bb43697e9" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-1ef9f180-8fab-4d89-8eed-d06bb43697e9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot 1ef9f180-8fab-4d89-8eed-d06bb43697e9 of volume ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4283fe2c-d5d1-46d7-bd81-02943b8e65a6]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:26 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 1073741824" returned: 0 in 0.584s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:26 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 Sep 07 10:05:26 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:26 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 Sep 07 10:05:26 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:26 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4860231d-9daf-4c8e-b693-14727b122197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f4da39-0964-4da3-9508-f882676d2127', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60eba98c-cc8b-4c46-8fb3-ad7aa29cd3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:26 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Volume volume-62f4da39-0964-4da3-9508-f882676d2127 (62f4da39-0964-4da3-9508-f882676d2127): created successfully Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60eba98c-cc8b-4c46-8fb3-ad7aa29cd3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:26 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (fc74bfa2-e03f-4961-ae49-5dbf59387223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9" returned: 0 in 0.497s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee477b0f-7895-49be-8601-2304ab5763c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:26 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8ee8a14d-cd4d-455f-b70a-b838829eabd3 tempest-ProjectReaderTests-1280600080 None] Created volume successfully. Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[756b8a7c-0781-4371-af21-2bb0f57f422a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:26 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 Sep 07 10:05:26 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:27 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3" returned: 0 in 0.378s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:27 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 Sep 07 10:05:27 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:27 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9" returned: 0 in 0.338s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:27 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9 Sep 07 10:05:27 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:27 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3.1ef9f180-8fab-4d89-8eed-d06bb43697e9" returned: 0 in 0.316s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-1ef9f180-8fab-4d89-8eed-d06bb43697e9" released by "_delete_snapshot" :: held 1.709s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ee477b0f-7895-49be-8601-2304ab5763c3" released by "delete_snapshot" :: held 1.746s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Creating offline snapshot 7bddd6bc-379f-4ac7-b616-73711f64a439 of volume 62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f22f1-c448-460a-b8d5-fe6c9486a3b2]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Created reservations ['7b4b6af7-8f0b-41bf-be64-cf165817236c', '7df3707d-0016-4ef0-b794-a139b24d6497', 'cfc9430b-5cbf-49a3-9680-bc889698e949', '08e9af2a-1feb-45b4-8b53-3f9d9ba75480'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5b2fa4ae-42f3-49c0-960f-1fe9c648d2ce tempest-ProjectMemberTests-542438711 None] Lock "cinder-1ef9f180-8fab-4d89-8eed-d06bb43697e9-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:28 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 Sep 07 10:05:28 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-ee477b0f-7895-49be-8601-2304ab5763c3-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Lock "cinder-ee477b0f-7895-49be-8601-2304ab5763c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-ee477b0f-7895-49be-8601-2304ab5763c3" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:28 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127" returned: 0 in 0.502s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ee477b0f-7895-49be-8601-2304ab5763c3" acquired by "delete_volume" :: waited 0.039s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:28 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 1G Sep 07 10:05:28 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50f61aa-ce54-4db4-aa3d-2ec1a140c5b8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:28 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 Sep 07 10:05:28 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3" returned: 0 in 0.427s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:29 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 1G" returned: 0 in 0.517s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62f4da39-0964-4da3-9508-f882676d2127 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:29 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3 Sep 07 10:05:29 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62f4da39-0964-4da3-9508-f882676d2127 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 Sep 07 10:05:29 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ee477b0f-7895-49be-8601-2304ab5763c3" returned: 0 in 0.271s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ee477b0f-7895-49be-8601-2304ab5763c3" released by "delete_volume" :: held 0.777s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Created reservations ['227c38ae-24ac-4d4d-9dc6-5e344e39397f', 'ce1681a5-5457-4f59-8ccb-c7247600db59', 'fa8e7168-2b0d-40d0-9ff3-abde5f04ed7d', 'a5b678bf-fc9b-4085-acaf-2edf2dbb4995'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:29 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62f4da39-0964-4da3-9508-f882676d2127 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439" returned: 0 in 0.356s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 is being set with open permissions: ugo+rw Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:29 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 Sep 07 10:05:29 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:29 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:29 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439" returned: 0 in 0.309s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:29 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.290s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:29 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.info Sep 07 10:05:29 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:05:29 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-062983d1-56d9-4cc3-b8e6-f4965987dd42 tempest-ProjectMemberTests-542438711 None] Lock "cinder-ee477b0f-7895-49be-8601-2304ab5763c3-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:30 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.info" returned: 0 in 0.314s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:30 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.info is being set with open permissions: ugo+rw Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:30 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.info Sep 07 10:05:30 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (60ff81c2-d6f5-499e-ba26-3604b5c6a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff4e31a-8799-44cb-a2b0-9538d531c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff4e31a-8799-44cb-a2b0-9538d531c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1680677549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c38a5a6-a15e-434e-87e8-026ce4555d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:30Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee5df42-133d-4acf-8ac7-1f415ddfe727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee5df42-133d-4acf-8ac7-1f415ddfe727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f6ef9f-be65-4598-806c-9e3559666e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f6ef9f-be65-4598-806c-9e3559666e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c38a5a6-a15e-434e-87e8-026ce4555d64', 'volume_name': 'volume-9c38a5a6-a15e-434e-87e8-026ce4555d64', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626b1adc-07ed-4025-85f2-3d1c53c977bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626b1adc-07ed-4025-85f2-3d1c53c977bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36756bbb-1c37-4b24-890a-cac3ca594704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:30 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Volume 9c38a5a6-a15e-434e-87e8-026ce4555d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c38a5a6-a15e-434e-87e8-026ce4555d64', 'volume_size': 1} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:30 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.info" returned: 0 in 0.312s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1680677549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c38a5a6-a15e-434e-87e8-026ce4555d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:30Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Creating volume 9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:30 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:30 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 1073741824 Sep 07 10:05:30 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-db0e5c5a-74a2-468f-a52d-7f52dc9b40ea tempest-ProjectReaderTests-1280600080 None] Create snapshot completed successfully Sep 07 10:05:30 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 1073741824" returned: 0 in 0.419s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:30 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 Sep 07 10:05:30 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:31 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64" returned: 0 in 0.272s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36756bbb-1c37-4b24-890a-cac3ca594704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c38a5a6-a15e-434e-87e8-026ce4555d64', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f272889-d703-4972-9dc8-0743b4308a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-7bddd6bc-379f-4ac7-b616-73711f64a439-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:31 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Volume volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 (9c38a5a6-a15e-434e-87e8-026ce4555d64): created successfully Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f272889-d703-4972-9dc8-0743b4308a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (60ff81c2-d6f5-499e-ba26-3604b5c6a964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:31 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bddd206a-be63-45a7-a25d-b22ba2fab8a9 tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-7bddd6bc-379f-4ac7-b616-73711f64a439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-62f4da39-0964-4da3-9508-f882676d2127" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-62f4da39-0964-4da3-9508-f882676d2127" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-7bddd6bc-379f-4ac7-b616-73711f64a439" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-7bddd6bc-379f-4ac7-b616-73711f64a439" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Deleting offline snapshot 7bddd6bc-379f-4ac7-b616-73711f64a439 of volume 62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] snapshot_file for this snap is: volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf1b4c0-b57b-4be8-8639-ac20253489c9]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:31 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 Sep 07 10:05:31 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:31 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439" returned: 0 in 0.370s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62f4da39-0964-4da3-9508-f882676d2127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee519f6f-a023-4bb1-9ccd-8dd47ff80b68]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:31 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 Sep 07 10:05:31 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:32 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127" returned: 0 in 0.366s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:32 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 Sep 07 10:05:32 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Creating offline snapshot c5b9635f-88af-4d10-816f-91d7ddc1c4d7 of volume 9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed844d2f-41aa-4932-94ac-b1d325d9ef55]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:32 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439" returned: 0 in 0.475s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:32 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439 Sep 07 10:05:32 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:32 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 Sep 07 10:05:32 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:32 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127.7bddd6bc-379f-4ac7-b616-73711f64a439" returned: 0 in 0.377s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-7bddd6bc-379f-4ac7-b616-73711f64a439" released by "_delete_snapshot" :: held 1.714s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-62f4da39-0964-4da3-9508-f882676d2127" released by "delete_snapshot" :: held 1.750s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:33 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64" returned: 0 in 0.554s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:33 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 1G Sep 07 10:05:33 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Created reservations ['391a1227-3652-4a97-9a15-d68c214ee6f4', '66e207a0-a511-45dc-816d-9266a94238bb', '80421e0f-c744-4dbf-97e3-08881dbe8a77', 'a354fcf2-46ec-44f5-8963-7ec4b54bb189'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:33 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Delete snapshot completed successfully. Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bda6f02b-f4c1-4969-aa40-a57162aad3f0 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-7bddd6bc-379f-4ac7-b616-73711f64a439-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-62f4da39-0964-4da3-9508-f882676d2127-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Lock "cinder-62f4da39-0964-4da3-9508-f882676d2127-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-62f4da39-0964-4da3-9508-f882676d2127" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-62f4da39-0964-4da3-9508-f882676d2127" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45ab47-9f3b-41a1-87b5-c144e92f1139]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:33 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 1G" returned: 0 in 0.595s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:33 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 Sep 07 10:05:33 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:33 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 Sep 07 10:05:33 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:34 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127" returned: 0 in 0.405s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:34 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7" returned: 0 in 0.352s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:34 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 is being set with open permissions: ugo+rw Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:34 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127 Sep 07 10:05:34 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:34 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 Sep 07 10:05:34 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:34 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-62f4da39-0964-4da3-9508-f882676d2127" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-62f4da39-0964-4da3-9508-f882676d2127" released by "delete_volume" :: held 0.782s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:34 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7" returned: 0 in 0.322s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:34 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.info Sep 07 10:05:34 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Created reservations ['a3c6655b-ce4b-48c7-be74-1e22bdf5ad9b', 'b75c470a-1d5e-4260-a539-d75f2268278c', '55bed24b-b22f-44f6-9a73-91a0202c0a92', '429bfb25-7748-4609-af63-4c40d15f8c67'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:34 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:34 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:34 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.info" returned: 0 in 0.310s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:34 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.info is being set with open permissions: ugo+rw Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:34 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.info Sep 07 10:05:34 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:34 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.320s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:34 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Deleted volume successfully. Sep 07 10:05:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3cec9c94-2aee-4333-8409-bee13565c76f tempest-ProjectReaderTests-1280600080 None] Lock "cinder-62f4da39-0964-4da3-9508-f882676d2127-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:35 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.info" returned: 0 in 0.352s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:35 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e4a94d07-1bef-4707-84ee-f04cf7e88e17 tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (07a75150-a056-4be7-92d9-81a2a9903a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa142433-d2e8-4b20-9581-4961091b5ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa142433-d2e8-4b20-9581-4961091b5ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489034180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d97ec0-9cf8-4090-a346-f2783f7c9f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:35Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335e102f-f65a-4967-95db-13655535f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335e102f-f65a-4967-95db-13655535f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617e7900-b874-4ac2-9d13-29bc78c5eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617e7900-b874-4ac2-9d13-29bc78c5eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d97ec0-9cf8-4090-a346-f2783f7c9f97', 'volume_name': 'volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5586c2b8-dca8-4b68-b12c-f6f73a6fe2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5586c2b8-dca8-4b68-b12c-f6f73a6fe2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ece7f23-7119-4f66-8d81-991c349fd5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:35 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Volume c6d97ec0-9cf8-4090-a346-f2783f7c9f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97', 'volume_size': 1} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489034180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d97ec0-9cf8-4090-a346-f2783f7c9f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae1858a376443295d89a82d6ed99d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:35Z,use_quota=True,user_id='844438e0a5a345efb38a385e32d3fef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Creating volume c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:35 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:35 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 1073741824 Sep 07 10:05:35 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-c5b9635f-88af-4d10-816f-91d7ddc1c4d7-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Lock "cinder-c5b9635f-88af-4d10-816f-91d7ddc1c4d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-9c38a5a6-a15e-434e-87e8-026ce4555d64" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-9c38a5a6-a15e-434e-87e8-026ce4555d64" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-c5b9635f-88af-4d10-816f-91d7ddc1c4d7" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-c5b9635f-88af-4d10-816f-91d7ddc1c4d7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot c5b9635f-88af-4d10-816f-91d7ddc1c4d7 of volume 9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e91ca12-816b-4bb4-85ef-76082d361213]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:35 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 1073741824" returned: 0 in 0.563s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:35 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:35 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 Sep 07 10:05:35 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:35 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 Sep 07 10:05:35 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:36 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" returned: 0 in 0.275s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ece7f23-7119-4f66-8d81-991c349fd5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab15bb9a-7646-4eff-8ef2-daef87eece4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:36 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:36 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Volume volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 (c6d97ec0-9cf8-4090-a346-f2783f7c9f97): created successfully Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab15bb9a-7646-4eff-8ef2-daef87eece4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Flow 'volume_create_manager' (07a75150-a056-4be7-92d9-81a2a9903a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7" returned: 0 in 0.454s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c38a5a6-a15e-434e-87e8-026ce4555d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:36 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0402d69f-841d-4024-8af0-5233614cd811 tempest-ProjectReaderTests-1280600080 None] Created volume successfully. Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecb30d5-6299-4e8e-be6d-e3f4cc2dcf76]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:36 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 Sep 07 10:05:36 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:36 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64" returned: 0 in 0.377s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:36 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:36 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 Sep 07 10:05:36 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:37 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7" returned: 0 in 0.382s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:37 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7 Sep 07 10:05:37 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:37 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64.c5b9635f-88af-4d10-816f-91d7ddc1c4d7" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-c5b9635f-88af-4d10-816f-91d7ddc1c4d7" released by "_delete_snapshot" :: held 1.632s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-9c38a5a6-a15e-434e-87e8-026ce4555d64" released by "delete_snapshot" :: held 1.664s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Created reservations ['be295d66-d8fa-4584-96fd-c2ccded912ce', '2cf7c978-93a7-469d-91ca-676801fce7be', '60539cba-c14b-4e03-b252-344623062133', '42129098-8305-4c93-96f5-402ae95bc866'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Creating offline snapshot f7b7bf0e-13dd-4075-868b-912067cc9418 of volume c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d823b392-6c6f-4abb-ba37-38e9aaf04ccd]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:37 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-3d2dcf43-b446-4536-bbfb-06d20ac49a23 tempest-ProjectMemberTests-542438711 None] Lock "cinder-c5b9635f-88af-4d10-816f-91d7ddc1c4d7-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:37 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 Sep 07 10:05:37 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-9c38a5a6-a15e-434e-87e8-026ce4555d64-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Lock "cinder-9c38a5a6-a15e-434e-87e8-026ce4555d64-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-9c38a5a6-a15e-434e-87e8-026ce4555d64" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:37 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-9c38a5a6-a15e-434e-87e8-026ce4555d64" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:37 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" returned: 0 in 0.442s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc3e9bd-f328-4378-a7a5-f68f186b5d14]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:38 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 1G Sep 07 10:05:38 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:38 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 Sep 07 10:05:38 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:38 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:38 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64 Sep 07 10:05:38 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:38 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 1G" returned: 0 in 0.485s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:38 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 Sep 07 10:05:38 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:38 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-9c38a5a6-a15e-434e-87e8-026ce4555d64" returned: 0 in 0.275s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-9c38a5a6-a15e-434e-87e8-026ce4555d64" released by "delete_volume" :: held 0.770s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Created reservations ['25039a8f-033b-482c-b695-703d30b6db3e', '1b5b9f83-5b14-4017-8c08-03aab9e96411', 'c1f58acc-7553-4670-b065-4e4007939336', 'f2e3bdeb-eed8-42a9-977c-49ca8f8d5199'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:38 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418" returned: 0 in 0.328s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:38 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 is being set with open permissions: ugo+rw Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:38 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 Sep 07 10:05:38 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:38 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:38 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:38 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:39 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418" returned: 0 in 0.386s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:39 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.info Sep 07 10:05:39 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:39 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.471s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:39 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-82a41c44-ac9c-4dc6-846f-9713c6dcef31 tempest-ProjectMemberTests-542438711 None] Lock "cinder-9c38a5a6-a15e-434e-87e8-026ce4555d64-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:39 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.info" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:39 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.info is being set with open permissions: ugo+rw Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:39 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.info Sep 07 10:05:39 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (796f5103-ace9-4c70-b7c5-ce7a0d5b79b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d337ff9-28a2-4a70-8346-de73c568f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d337ff9-28a2-4a70-8346-de73c568f563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499510994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad86351f-9541-4b02-9bb2-dd99df5c1d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:40Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c33d201-69c1-46e1-b87c-929ba9d70fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c33d201-69c1-46e1-b87c-929ba9d70fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bf28a1-8e92-4f5a-85d2-cecc461d4f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bf28a1-8e92-4f5a-85d2-cecc461d4f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad86351f-9541-4b02-9bb2-dd99df5c1d22', 'volume_name': 'volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a64580-63c0-43a4-890a-e90f1f51d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a64580-63c0-43a4-890a-e90f1f51d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e47060a-00cf-4fa3-9af9-3238aff6b25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Volume ad86351f-9541-4b02-9bb2-dd99df5c1d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22', 'volume_size': 1} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:39 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.info" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499510994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad86351f-9541-4b02-9bb2-dd99df5c1d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:40Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Creating volume ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:39 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:39 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:40 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 1073741824 Sep 07 10:05:40 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-061b29bc-d9e8-412a-9d1d-07eb3515d1f1 tempest-ProjectReaderTests-1280600080 None] Create snapshot completed successfully Sep 07 10:05:40 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 1073741824" returned: 0 in 0.443s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:40 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 Sep 07 10:05:40 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Flow 'volume_create_manager' (912892ea-a23d-4658-a0c7-ab9f3fac20ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df8bfda-da0a-4565-8f9e-71e0d75bc8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-f7b7bf0e-13dd-4075-868b-912067cc9418-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:40 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df8bfda-da0a-4565-8f9e-71e0d75bc8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-3712684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32afe10-c0b2-4716-918b-3ccfb1374036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a50489574314ac29b1dbd614e6c1575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:41Z,use_quota=True,user_id='4a2d6091f7f94e208fc0ea71b1368ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295ab57f-bd47-4591-b6e2-5b3a2bb22888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295ab57f-bd47-4591-b6e2-5b3a2bb22888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c929b3-7cc9-4193-b029-f6d6189f39ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c929b3-7cc9-4193-b029-f6d6189f39ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32afe10-c0b2-4716-918b-3ccfb1374036', 'volume_name': 'volume-c32afe10-c0b2-4716-918b-3ccfb1374036', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4a392e-7f81-4430-aa16-0f9024227ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4a392e-7f81-4430-aa16-0f9024227ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19cc54d-dc2f-4ee1-acd7-5f76a12b57d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Volume c32afe10-c0b2-4716-918b-3ccfb1374036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32afe10-c0b2-4716-918b-3ccfb1374036', 'volume_size': 1} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22" returned: 0 in 0.336s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-3712684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32afe10-c0b2-4716-918b-3ccfb1374036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a50489574314ac29b1dbd614e6c1575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:41Z,use_quota=True,user_id='4a2d6091f7f94e208fc0ea71b1368ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Creating volume c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:40 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-f7b7bf0e-13dd-4075-868b-912067cc9418-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:40 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 1073741824 Sep 07 10:05:40 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e47060a-00cf-4fa3-9af9-3238aff6b25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186f81d9-dab9-412e-829f-a9e5c5bb5b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-f7b7bf0e-13dd-4075-868b-912067cc9418" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:40 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Volume volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 (ad86351f-9541-4b02-9bb2-dd99df5c1d22): created successfully Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186f81d9-dab9-412e-829f-a9e5c5bb5b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (796f5103-ace9-4c70-b7c5-ce7a0d5b79b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-f7b7bf0e-13dd-4075-868b-912067cc9418" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Deleting offline snapshot f7b7bf0e-13dd-4075-868b-912067cc9418 of volume c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] snapshot_file for this snap is: volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:40 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5140eacf-c50c-4817-ab54-d1615074de1f tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab94036-4d59-47fd-9126-7ed117dc7d6b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:40 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:41 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 Sep 07 10:05:41 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:41 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:41 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:41 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 1073741824" returned: 0 in 0.464s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:41 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:41 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 Sep 07 10:05:41 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418" returned: 0 in 0.410s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe3198a-cc9f-49dc-9b80-7ab110c39c3d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:41 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.288s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:05:41 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 Sep 07 10:05:41 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:41 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036" returned: 0 in 0.276s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19cc54d-dc2f-4ee1-acd7-5f76a12b57d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32afe10-c0b2-4716-918b-3ccfb1374036', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc08085-ba0b-4754-84a3-9568e22aaf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:41 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Volume volume-c32afe10-c0b2-4716-918b-3ccfb1374036 (c32afe10-c0b2-4716-918b-3ccfb1374036): created successfully Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc08085-ba0b-4754-84a3-9568e22aaf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Flow 'volume_create_manager' (912892ea-a23d-4658-a0c7-ab9f3fac20ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:41 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-00205a1f-7f17-41c7-893b-cb1ce02fab3e tempest-SnapshotDependencyTests-213935632 None] Created volume successfully. Sep 07 10:05:41 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" returned: 0 in 0.399s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:41 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 Sep 07 10:05:41 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Creating offline snapshot 9e849381-bf90-4483-b4f8-adf720dbebc8 of volume ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5215a601-597f-4e4b-a026-702dd6f4dffd]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:42 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418" returned: 0 in 0.363s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:42 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 Sep 07 10:05:42 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:42 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418 Sep 07 10:05:42 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:42 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97.f7b7bf0e-13dd-4075-868b-912067cc9418" returned: 0 in 0.262s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:42 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22" returned: 0 in 0.383s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-f7b7bf0e-13dd-4075-868b-912067cc9418" released by "_delete_snapshot" :: held 1.551s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" released by "delete_snapshot" :: held 1.594s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:42 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 1G Sep 07 10:05:42 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Created reservations ['999b88bc-46d2-4e2e-a669-1c177d30fe9b', 'abd33f50-7129-43e5-85c7-ddb4ea571abd', 'f4eff775-4ba9-4d9f-b85a-dc98f524a203', '3a72cfd8-cdd9-47f0-babe-ce6d06558538'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:42 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Delete snapshot completed successfully. Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-b96c6187-8a5a-4826-88cb-566432e9ba15 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-f7b7bf0e-13dd-4075-868b-912067cc9418-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:42 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 1G" returned: 0 in 0.430s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:42 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 Sep 07 10:05:42 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-c6d97ec0-9cf8-4090-a346-f2783f7c9f97-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:42 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-c6d97ec0-9cf8-4090-a346-f2783f7c9f97-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "cinder-quobyte-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" acquired by "delete_volume" :: waited 0.031s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[597c4085-ce37-4c63-97d1-54203f7f6dba]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:43 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 Sep 07 10:05:43 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:43 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8" returned: 0 in 0.364s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:43 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 is being set with open permissions: ugo+rw Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:43 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 Sep 07 10:05:43 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:43 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:43 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8" returned: 0 in 0.242s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" returned: 0 in 0.384s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:43 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97 Sep 07 10:05:43 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:43 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.info Sep 07 10:05:43 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:43 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" returned: 0 in 0.253s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-quobyte-c6d97ec0-9cf8-4090-a346-f2783f7c9f97" released by "delete_volume" :: held 0.716s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:43 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.info" returned: 0 in 0.268s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:43 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.info is being set with open permissions: ugo+rw Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:43 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.info Sep 07 10:05:43 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Created reservations ['a70a8b9f-94d2-457c-9457-ee1ff7873115', '50258a32-9e2c-497e-bfa2-df56d4dca38a', '2e56f953-776f-4f51-a937-1c6705f624c1', '128c8126-5e38-426f-9832-e924a1423c6d'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:43 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:43 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:43 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:44 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.info" returned: 0 in 0.270s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.982s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Creating offline snapshot 96b72429-7f40-434b-86c7-a6ef32177be1 of volume c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8199b407-c4cd-4e0e-8699-ef00be554f02 tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d66d28-663f-4cf0-aa94-58daf13c803c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:44 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.301s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:44 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Deleted volume successfully. Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9bc543ae-d83b-4192-98fc-3e5ddb976e28 tempest-ProjectReaderTests-1280600080 None] Lock "cinder-c6d97ec0-9cf8-4090-a346-f2783f7c9f97-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:44 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 Sep 07 10:05:44 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:44 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036" returned: 0 in 0.414s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:44 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:44 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 1G Sep 07 10:05:44 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:45 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 1G" returned: 0 in 0.459s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c32afe10-c0b2-4716-918b-3ccfb1374036 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:45 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c32afe10-c0b2-4716-918b-3ccfb1374036 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 Sep 07 10:05:45 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-9e849381-bf90-4483-b4f8-adf720dbebc8-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Lock "cinder-9e849381-bf90-4483-b4f8-adf720dbebc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-ad86351f-9541-4b02-9bb2-dd99df5c1d22" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ad86351f-9541-4b02-9bb2-dd99df5c1d22" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-9e849381-bf90-4483-b4f8-adf720dbebc8" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-9e849381-bf90-4483-b4f8-adf720dbebc8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot 9e849381-bf90-4483-b4f8-adf720dbebc8 of volume ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e756ed4c-8d24-4c3b-a05f-d1f7363a83fe]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:45 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c32afe10-c0b2-4716-918b-3ccfb1374036 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1" returned: 0 in 0.390s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:45 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 is being set with open permissions: ugo+rw Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:45 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 Sep 07 10:05:45 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:45 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 Sep 07 10:05:45 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:45 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1" returned: 0 in 0.288s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:45 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8" returned: 0 in 0.423s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:45 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.info Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:45 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa14d574-08bf-4881-a60e-d46ee336628c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:45 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:45 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 Sep 07 10:05:45 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:46 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.info" returned: 0 in 0.300s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:46 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.info is being set with open permissions: ugo+rw Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:46 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.info Sep 07 10:05:46 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:46 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22" returned: 0 in 0.428s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:46 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 Sep 07 10:05:46 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:46 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.info" returned: 0 in 0.266s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:46 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-942943bd-b9b6-4d7e-96f0-4008f6f3113b tempest-SnapshotDependencyTests-213935632 None] Create snapshot completed successfully Sep 07 10:05:46 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8" returned: 0 in 0.407s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:46 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8 Sep 07 10:05:46 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:46 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22.9e849381-bf90-4483-b4f8-adf720dbebc8" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-9e849381-bf90-4483-b4f8-adf720dbebc8" released by "_delete_snapshot" :: held 1.635s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:46 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ad86351f-9541-4b02-9bb2-dd99df5c1d22" released by "delete_snapshot" :: held 1.663s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Created reservations ['4cdd9100-9ce0-42fb-aea0-2d0281cdf3df', '972b15e7-e90a-4f60-8ea7-320db4c1dd6b', '4490f06a-79c5-46f3-a385-67924a619bc9', 'a2bcb8ad-b672-421f-8c90-f434eaa9c217'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:47 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-9af3213e-166f-4a9c-96d1-0e0eb2bc9128 tempest-ProjectMemberTests-542438711 None] Lock "cinder-9e849381-bf90-4483-b4f8-adf720dbebc8-delete_snapshot" released by "delete_snapshot" :: held 1.838s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-ad86351f-9541-4b02-9bb2-dd99df5c1d22-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Lock "cinder-ad86351f-9541-4b02-9bb2-dd99df5c1d22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-ad86351f-9541-4b02-9bb2-dd99df5c1d22" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ad86351f-9541-4b02-9bb2-dd99df5c1d22" acquired by "delete_volume" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[999fee6e-3e33-4a5f-9b03-0fc1f085814b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:47 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:47 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 Sep 07 10:05:47 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Flow 'volume_create_manager' (bdd092f5-54f4-4db2-a48c-93d2bbaf08b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbe3eac-0af0-4702-a867-c97956d3910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:48 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22" returned: 0 in 0.462s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbe3eac-0af0-4702-a867-c97956d3910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f244ee-68ae-4d70-bdd2-fe5125cd201d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a50489574314ac29b1dbd614e6c1575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=96b72429-7f40-434b-86c7-a6ef32177be1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:48Z,use_quota=True,user_id='4a2d6091f7f94e208fc0ea71b1368ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:48 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22 Sep 07 10:05:48 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534a994-cc60-4752-a1e3-bf88940f73c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534a994-cc60-4752-a1e3-bf88940f73c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecc2795-0a6f-4660-bfc4-e1acacce44c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecc2795-0a6f-4660-bfc4-e1acacce44c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19f244ee-68ae-4d70-bdd2-fe5125cd201d', 'volume_name': 'volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d', 'volume_size': 1, 'snapshot_id': '96b72429-7f40-434b-86c7-a6ef32177be1'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0009c7df-e938-4d5b-b41b-eb8edefc46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0009c7df-e938-4d5b-b41b-eb8edefc46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415d98d0-ffe8-4f5b-8f85-ff9ee6b8abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:48 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Volume 19f244ee-68ae-4d70-bdd2-fe5125cd201d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d', 'volume_size': 1, 'snapshot_id': '96b72429-7f40-434b-86c7-a6ef32177be1'} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-quobyte-96b72429-7f40-434b-86c7-a6ef32177be1-19f244ee-68ae-4d70-bdd2-fe5125cd201d" by "_create_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-96b72429-7f40-434b-86c7-a6ef32177be1-19f244ee-68ae-4d70-bdd2-fe5125cd201d" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Creating volume 19f244ee-68ae-4d70-bdd2-fe5125cd201d from snapshot 96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-quobyte-19f244ee-68ae-4d70-bdd2-fe5125cd201d" by "_copy_volume_from_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-19f244ee-68ae-4d70-bdd2-fe5125cd201d" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] snapshot: 96b72429-7f40-434b-86c7-a6ef32177be1, volume: 19f244ee-68ae-4d70-bdd2-fe5125cd201d, {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d9e21-452b-483f-82f8-594ca1e70842]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:48 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-ad86351f-9541-4b02-9bb2-dd99df5c1d22" returned: 0 in 0.306s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-ad86351f-9541-4b02-9bb2-dd99df5c1d22" released by "delete_volume" :: held 0.847s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:48 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 Sep 07 10:05:48 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Created reservations ['bfd7d89c-9096-4cf1-8ebb-f181c836b81c', '2abf5172-0499-446c-a4c1-e89b3d029af7', '51d5132a-dc79-4082-a3ff-96235137c07a', 'b94d6322-6ff6-459a-9b37-7946ff8e99f2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:48 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:48 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:48 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1" returned: 0 in 0.500s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c32afe10-c0b2-4716-918b-3ccfb1374036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f7630-d79b-466a-91a0-f344426708d8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:48 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.340s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:48 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:05:48 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-043a7e6b-c178-45ce-ab0c-bfa3d24557cc tempest-ProjectMemberTests-542438711 None] Lock "cinder-ad86351f-9541-4b02-9bb2-dd99df5c1d22-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:49 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 Sep 07 10:05:49 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:49 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (c7e1cbd1-a70b-4e87-ba62-4ab051ddcd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6086a197-c45a-4ef4-8f20-525c29ce28d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036" returned: 0 in 0.522s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Creating direct copy from snapshot {{(pid=87290) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.utils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Path /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d not found in is_blk_device check {{(pid=87290) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6086a197-c45a-4ef4-8f20-525c29ce28d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735755060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9984af-dfd4-4f4c-84c6-be909018d6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:49Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d Sep 07 10:05:49 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32f63c8-411b-450a-bb7d-1e5323d74a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32f63c8-411b-450a-bb7d-1e5323d74a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269a5509-751e-4b19-94a6-d8d24b18a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269a5509-751e-4b19-94a6-d8d24b18a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9984af-dfd4-4f4c-84c6-be909018d6d4', 'volume_name': 'volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e82333d-0c1b-4aab-8934-3abcd88f906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e82333d-0c1b-4aab-8934-3abcd88f906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7b79f3-384d-46f3-8009-b01e6d32f6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Volume eb9984af-dfd4-4f4c-84c6-be909018d6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4', 'volume_size': 1} Sep 07 10:05:49 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:54 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d" returned: 0 in 4.706s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.image.image_utils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Image conversion details: src /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d {{(pid=87290) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:05:54 devstack cinder-volume[87290]: INFO cinder.image.image_utils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Converted 1024.00 MB image at 217.55 MB/s Sep 07 10:05:54 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d is being set with open permissions: ugo+rw Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d Sep 07 10:05:54 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:54 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d" returned: 0 in 0.265s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-19f244ee-68ae-4d70-bdd2-fe5125cd201d" released by "_copy_volume_from_snapshot" :: held 6.109s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-96b72429-7f40-434b-86c7-a6ef32177be1-19f244ee-68ae-4d70-bdd2-fe5125cd201d" released by "_create_volume_from_snapshot" :: held 6.185s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.211s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.967s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735755060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9984af-dfd4-4f4c-84c6-be909018d6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:49Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Creating volume eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:54 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 1073741824 Sep 07 10:05:54 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415d98d0-ffe8-4f5b-8f85-ff9ee6b8abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d', 'volume_size': 1, 'snapshot_id': '96b72429-7f40-434b-86c7-a6ef32177be1'}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7b2937-de82-4fc9-b776-b173a42a22aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:54 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Volume volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d (19f244ee-68ae-4d70-bdd2-fe5125cd201d): created successfully Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7b2937-de82-4fc9-b776-b173a42a22aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Flow 'volume_create_manager' (bdd092f5-54f4-4db2-a48c-93d2bbaf08b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:54 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-48922191-21db-4214-9e44-9a2000986200 tempest-SnapshotDependencyTests-213935632 None] Created volume successfully. Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-96b72429-7f40-434b-86c7-a6ef32177be1-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-96b72429-7f40-434b-86c7-a6ef32177be1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-quobyte-c32afe10-c0b2-4716-918b-3ccfb1374036" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-c32afe10-c0b2-4716-918b-3ccfb1374036" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-quobyte-96b72429-7f40-434b-86c7-a6ef32177be1" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-96b72429-7f40-434b-86c7-a6ef32177be1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Deleting offline snapshot 96b72429-7f40-434b-86c7-a6ef32177be1 of volume c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] snapshot_file for this snap is: volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a68a6a8-3e15-4c68-bd3c-a9b6c7984a15]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 1073741824" returned: 0 in 0.517s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:54 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 Sep 07 10:05:54 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:54 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 Sep 07 10:05:54 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:55 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1" returned: 0 in 0.386s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c32afe10-c0b2-4716-918b-3ccfb1374036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:55 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4" returned: 0 in 0.291s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7b79f3-384d-46f3-8009-b01e6d32f6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffa93e4-946b-4079-98cf-1a2a6cf78b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[50815968-0cfb-482f-b7f3-8ee5bf315519]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:55 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Volume volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 (eb9984af-dfd4-4f4c-84c6-be909018d6d4): created successfully Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffa93e4-946b-4079-98cf-1a2a6cf78b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (c7e1cbd1-a70b-4e87-ba62-4ab051ddcd2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:55 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-636dcc02-8040-4436-b79d-0f7c04714f3d tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:05:55 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 Sep 07 10:05:55 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:55 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036" returned: 0 in 0.569s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:55 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:55 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 Sep 07 10:05:55 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Creating offline snapshot f20665b7-e569-4a38-a381-103a4bcb0b13 of volume eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5fec38-3430-46ae-a2b1-6cd2522f8022]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:56 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:56 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1" returned: 0 in 0.454s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:56 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:56 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1 Sep 07 10:05:56 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:56 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036.96b72429-7f40-434b-86c7-a6ef32177be1" returned: 0 in 0.272s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-96b72429-7f40-434b-86c7-a6ef32177be1" released by "_delete_snapshot" :: held 1.815s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:56 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4" returned: 0 in 0.469s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-c32afe10-c0b2-4716-918b-3ccfb1374036" released by "delete_snapshot" :: held 1.853s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:56 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 1G Sep 07 10:05:56 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Created reservations ['009e859f-7b72-4c0e-a481-02f2efe8a46c', 'd9e42307-d812-454c-9766-10d09e1a0902', '4ed166a1-b355-4d7a-a26e-0e9ee397e685', 'aa518027-f967-46e2-a5c3-4eb3b9cab914'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:56 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Delete snapshot completed successfully. Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-6b8b2faa-bf62-4254-80c9-1742d9dec66b tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-96b72429-7f40-434b-86c7-a6ef32177be1-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-c32afe10-c0b2-4716-918b-3ccfb1374036-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-c32afe10-c0b2-4716-918b-3ccfb1374036-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:56 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-quobyte-c32afe10-c0b2-4716-918b-3ccfb1374036" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-c32afe10-c0b2-4716-918b-3ccfb1374036" acquired by "delete_volume" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bddd3b-eb22-4448-8a7d-34cd424ed32e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:57 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 1G" returned: 0 in 0.525s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:57 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 Sep 07 10:05:57 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:57 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 Sep 07 10:05:57 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:57 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13" returned: 0 in 0.328s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:57 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 is being set with open permissions: ugo+rw Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:57 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036" returned: 0 in 0.452s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:57 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 Sep 07 10:05:57 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:57 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036 Sep 07 10:05:57 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:57 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13" returned: 0 in 0.275s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:57 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c32afe10-c0b2-4716-918b-3ccfb1374036" returned: 0 in 0.298s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:57 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.info Sep 07 10:05:57 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-c32afe10-c0b2-4716-918b-3ccfb1374036" released by "delete_volume" :: held 0.818s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Created reservations ['d0d34b33-3376-4b5c-8031-b42820acb1d9', 'b3a3846c-5ac9-4d7a-bb05-d439e23deb9d', '8b77fe30-f2d3-4dde-b450-2e9fc9abc241', '7e563f8f-d521-4049-be43-0cf1548e7c5c'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:57 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:57 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:57 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:58 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.info" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:58 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.info is being set with open permissions: ugo+rw Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-19f244ee-68ae-4d70-bdd2-fe5125cd201d-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:58 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.info Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-19f244ee-68ae-4d70-bdd2-fe5125cd201d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:58 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "cinder-quobyte-19f244ee-68ae-4d70-bdd2-fe5125cd201d" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-19f244ee-68ae-4d70-bdd2-fe5125cd201d" acquired by "delete_volume" :: waited 0.040s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[067eaa25-ad68-4d9b-8a79-1708902a3eea]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:58 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.360s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Deleted volume successfully. Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-40532c29-21b4-47d6-83e1-a72b39458e2f tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-c32afe10-c0b2-4716-918b-3ccfb1374036-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:58 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d Sep 07 10:05:58 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:58 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.info" returned: 0 in 0.433s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:58 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-680486d4-c30d-4593-bdd4-ceb4c7319e9e tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:05:58 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:58 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d Sep 07 10:05:58 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:58 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-19f244ee-68ae-4d70-bdd2-fe5125cd201d" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:58 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-quobyte-19f244ee-68ae-4d70-bdd2-fe5125cd201d" released by "delete_volume" :: held 0.743s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Created reservations ['bfdb9eca-c984-477c-a816-1e43b78534ba', '42252f55-c188-410a-a1b3-aa1b1327a837', '2bd3f3f6-951c-4853-ad04-0f3d706d299e', 'dabd26d6-f598-4939-a007-6ba5c41abed2'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:59 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:05:59 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-f20665b7-e569-4a38-a381-103a4bcb0b13-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Lock "cinder-f20665b7-e569-4a38-a381-103a4bcb0b13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-eb9984af-dfd4-4f4c-84c6-be909018d6d4" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:59 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.294s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-eb9984af-dfd4-4f4c-84c6-be909018d6d4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-f20665b7-e569-4a38-a381-103a4bcb0b13" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:59 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Deleted volume successfully. Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-f20665b7-e569-4a38-a381-103a4bcb0b13" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot f20665b7-e569-4a38-a381-103a4bcb0b13 of volume eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5a8fe-7ef1-481c-8566-b947db5233ee]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-8adcc25f-c829-4536-8da8-8cc6fa4e504a tempest-SnapshotDependencyTests-213935632 None] Lock "cinder-19f244ee-68ae-4d70-bdd2-fe5125cd201d-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:59 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 Sep 07 10:05:59 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:59 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13" returned: 0 in 0.387s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[86114f73-9ca0-4c11-9d93-3870cf48dd1e]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:59 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:00 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 Sep 07 10:06:00 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:00 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4" returned: 0 in 0.468s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:00 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 Sep 07 10:06:00 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:00 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13" returned: 0 in 0.388s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:00 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:00 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13 Sep 07 10:06:00 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:01 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4.f20665b7-e569-4a38-a381-103a4bcb0b13" returned: 0 in 0.287s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-f20665b7-e569-4a38-a381-103a4bcb0b13" released by "_delete_snapshot" :: held 1.663s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-eb9984af-dfd4-4f4c-84c6-be909018d6d4" released by "delete_snapshot" :: held 1.709s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Created reservations ['fcd6db2a-80f0-4043-8428-09558e3f8de5', '5c8ed620-6d70-4681-a7db-379c548e5964', '3a78818e-2dea-430d-b3f8-1b54ad490235', '54671b1a-c529-434b-8b5e-19a222cc74f9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:01 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-e774d706-e426-4e15-a873-38c3c1413665 tempest-ProjectMemberTests-542438711 None] Lock "cinder-f20665b7-e569-4a38-a381-103a4bcb0b13-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-eb9984af-dfd4-4f4c-84c6-be909018d6d4-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (04dedcc3-f162-4773-8f64-4e56889ea0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea3df84-f441-4cec-b58f-152df185f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea3df84-f441-4cec-b58f-152df185f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451618622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06987a1-2eef-49b4-b2e9-b79494dc347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:02Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c00e761-115b-46ba-af34-7928d915d834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c00e761-115b-46ba-af34-7928d915d834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd17b1d-2529-412f-8c76-d0ef2bf1d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd17b1d-2529-412f-8c76-d0ef2bf1d76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06987a1-2eef-49b4-b2e9-b79494dc347b', 'volume_name': 'volume-b06987a1-2eef-49b4-b2e9-b79494dc347b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986cb2fd-a805-4225-a1da-3f24b2c108b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986cb2fd-a805-4225-a1da-3f24b2c108b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6761b297-1b61-4108-b33c-f1b72932302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:01 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Volume b06987a1-2eef-49b4-b2e9-b79494dc347b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06987a1-2eef-49b4-b2e9-b79494dc347b', 'volume_size': 1} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451618622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06987a1-2eef-49b4-b2e9-b79494dc347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:02Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Creating volume b06987a1-2eef-49b4-b2e9-b79494dc347b {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:01 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Lock "cinder-eb9984af-dfd4-4f4c-84c6-be909018d6d4-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:01 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b 1073741824 Sep 07 10:06:01 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-eb9984af-dfd4-4f4c-84c6-be909018d6d4" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-eb9984af-dfd4-4f4c-84c6-be909018d6d4" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6046ed-6913-4c6f-8b97-abc6800f3e2c]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:01 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:01 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 Sep 07 10:06:01 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:02 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b 1073741824" returned: 0 in 0.456s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:02 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b Sep 07 10:06:02 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:02 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4" returned: 0 in 0.440s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:02 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4 Sep 07 10:06:02 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:02 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b" returned: 0 in 0.293s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6761b297-1b61-4108-b33c-f1b72932302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06987a1-2eef-49b4-b2e9-b79494dc347b', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13db9cf0-1022-420c-bbc0-3a6176846a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:02 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Volume volume-b06987a1-2eef-49b4-b2e9-b79494dc347b (b06987a1-2eef-49b4-b2e9-b79494dc347b): created successfully Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13db9cf0-1022-420c-bbc0-3a6176846a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (04dedcc3-f162-4773-8f64-4e56889ea0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-592e08c8-9a01-4026-bb82-224d4ed76f1a tempest-ProjectReaderTests-2056182684 None] Created volume successfully. Sep 07 10:06:02 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-eb9984af-dfd4-4f4c-84c6-be909018d6d4" returned: 0 in 0.267s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-eb9984af-dfd4-4f4c-84c6-be909018d6d4" released by "delete_volume" :: held 0.773s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Created reservations ['9882e225-9fb2-4461-9a6f-b60747d9f279', '64f3c129-a72d-4233-8e84-d6564dac2031', 'd9977902-507a-4b1d-aa7d-810ea87b3584', '20288805-a3d0-4baa-bad1-f201218fdaa3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:02 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:02 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:02 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.248s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:02 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:02 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0bb268ba-24d3-4f4e-8d58-e1260b6db825 tempest-ProjectMemberTests-542438711 None] Lock "cinder-eb9984af-dfd4-4f4c-84c6-be909018d6d4-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (3e1765b9-7b30-451f-81e4-54509cef8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43795253-55c7-4fef-9fe2-da68f02a725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43795253-55c7-4fef-9fe2-da68f02a725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286845971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2799de-6135-46e1-8e89-dd618f4aadb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:03Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55c73c8-70f4-432e-8591-fd38e6fdc03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55c73c8-70f4-432e-8591-fd38e6fdc03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24ca33a-1d47-4e5b-8f30-0f5738a6e302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24ca33a-1d47-4e5b-8f30-0f5738a6e302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2799de-6135-46e1-8e89-dd618f4aadb6', 'volume_name': 'volume-2d2799de-6135-46e1-8e89-dd618f4aadb6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad613205-ebfa-445b-875e-ed7e6d1c7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad613205-ebfa-445b-875e-ed7e6d1c7666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d6915d-7e57-431a-b1bd-eef9535657b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:03 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Volume 2d2799de-6135-46e1-8e89-dd618f4aadb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2799de-6135-46e1-8e89-dd618f4aadb6', 'volume_size': 1} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286845971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2799de-6135-46e1-8e89-dd618f4aadb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:03Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Creating volume 2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:03 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:03 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 1073741824 Sep 07 10:06:03 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-b06987a1-2eef-49b4-b2e9-b79494dc347b-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-b06987a1-2eef-49b4-b2e9-b79494dc347b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:03 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-quobyte-b06987a1-2eef-49b4-b2e9-b79494dc347b" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 1073741824" returned: 0 in 0.543s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-b06987a1-2eef-49b4-b2e9-b79494dc347b" acquired by "delete_volume" :: waited 0.025s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d538fa6d-5228-4d03-b731-4da36e5c7305]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:03 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:04 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 Sep 07 10:06:04 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:04 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b Sep 07 10:06:04 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:04 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6" returned: 0 in 0.331s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d6915d-7e57-431a-b1bd-eef9535657b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2799de-6135-46e1-8e89-dd618f4aadb6', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2423a792-9d20-464f-95f8-d4d88b7cf755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:04 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Volume volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 (2d2799de-6135-46e1-8e89-dd618f4aadb6): created successfully Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2423a792-9d20-464f-95f8-d4d88b7cf755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (3e1765b9-7b30-451f-81e4-54509cef8d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:04 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-33ea34a6-4e3a-43a7-a0a2-5210bb3a92b3 tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:06:04 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b" returned: 0 in 0.483s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:04 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b Sep 07 10:06:04 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:04 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b06987a1-2eef-49b4-b2e9-b79494dc347b" returned: 0 in 0.238s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-b06987a1-2eef-49b4-b2e9-b79494dc347b" released by "delete_volume" :: held 0.775s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Created reservations ['1e0d255e-1399-45a6-af4b-0899c88e0b03', '30505321-e248-4207-9985-24e800536303', 'de4beba8-f1a9-44dc-869d-d8968702091f', '91a5468e-741f-4685-8987-2ae036c4e664'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:04 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:04 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:04 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:05 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:05 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Deleted volume successfully. Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bad1739e-4e96-4f20-9306-0c3b189ef999 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-b06987a1-2eef-49b4-b2e9-b79494dc347b-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (5db167e7-deed-4ab7-b58a-efdd2ee23c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731803a-7eda-49ea-bd07-2acb755764ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Creating offline snapshot b7bf8118-a32b-4f32-b376-9645930c844f of volume 2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731803a-7eda-49ea-bd07-2acb755764ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436813275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066601e8-9f1e-4fee-bd85-96d6637afc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:06Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f455d59d-14c2-40e3-a52d-a9b5d6f98afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f455d59d-14c2-40e3-a52d-a9b5d6f98afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f53781-f3d3-496c-98e3-30106ca0d5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f53781-f3d3-496c-98e3-30106ca0d5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066601e8-9f1e-4fee-bd85-96d6637afc40', 'volume_name': 'volume-066601e8-9f1e-4fee-bd85-96d6637afc40', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887f234f-05b7-480c-b8a0-ff6d9e83b606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887f234f-05b7-480c-b8a0-ff6d9e83b606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0685797-b4f6-4e89-9279-fb0359b0336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:05 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Volume 066601e8-9f1e-4fee-bd85-96d6637afc40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066601e8-9f1e-4fee-bd85-96d6637afc40', 'volume_size': 1} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba97cb4-bcf8-40f8-a5f4-7cac0f679034]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:05 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:05 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 Sep 07 10:06:05 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:06 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6" returned: 0 in 0.398s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:06 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f 1G Sep 07 10:06:06 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:06 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f 1G" returned: 0 in 0.411s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:06 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f Sep 07 10:06:06 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:06 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f" returned: 0 in 0.319s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:06 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f is being set with open permissions: ugo+rw Sep 07 10:06:06 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:06 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f Sep 07 10:06:06 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:07 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f" returned: 0 in 0.250s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:07 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.info Sep 07 10:06:07 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:07 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.info" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:07 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.info is being set with open permissions: ugo+rw Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:07 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.info Sep 07 10:06:07 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:07 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.info" returned: 0 in 0.259s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.935s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436813275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066601e8-9f1e-4fee-bd85-96d6637afc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:06Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Creating volume 066601e8-9f1e-4fee-bd85-96d6637afc40 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:07 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:07 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:07 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 1073741824 Sep 07 10:06:07 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:07 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f6841d5d-f351-4ad2-97e3-fa84475cfb71 tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:06:08 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 1073741824" returned: 0 in 0.510s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=157,cinder:INSERT=65,cinder:UPDATE=209,cinder:DELETE=17 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=175,cinder:UPDATE=205,cinder:INSERT=47,cinder:DELETE=19 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:08 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 Sep 07 10:06:08 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:08 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40" returned: 0 in 0.260s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0685797-b4f6-4e89-9279-fb0359b0336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066601e8-9f1e-4fee-bd85-96d6637afc40', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da68510-764e-442f-aad6-b437d7cfb77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:08 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Volume volume-066601e8-9f1e-4fee-bd85-96d6637afc40 (066601e8-9f1e-4fee-bd85-96d6637afc40): created successfully Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da68510-764e-442f-aad6-b437d7cfb77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (5db167e7-deed-4ab7-b58a-efdd2ee23c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:08 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-dda80dbe-4a0c-4cbf-a8a2-b94cd4055bcf tempest-ProjectReaderTests-2056182684 None] Created volume successfully. Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-b7bf8118-a32b-4f32-b376-9645930c844f-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Lock "cinder-b7bf8118-a32b-4f32-b376-9645930c844f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-2d2799de-6135-46e1-8e89-dd618f4aadb6" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-2d2799de-6135-46e1-8e89-dd618f4aadb6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-b7bf8118-a32b-4f32-b376-9645930c844f" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-b7bf8118-a32b-4f32-b376-9645930c844f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot b7bf8118-a32b-4f32-b376-9645930c844f of volume 2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63eb859-c550-4ca2-b610-9b8b45e4cc7d]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:08 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:08 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f Sep 07 10:06:08 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:09 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f" returned: 0 in 0.371s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d2799de-6135-46e1-8e89-dd618f4aadb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c5a57f-2f91-4b37-9aab-2220759806d4]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:09 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 Sep 07 10:06:09 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:09 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6" returned: 0 in 0.412s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:09 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f Sep 07 10:06:09 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-066601e8-9f1e-4fee-bd85-96d6637afc40-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Lock "cinder-066601e8-9f1e-4fee-bd85-96d6637afc40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-quobyte-066601e8-9f1e-4fee-bd85-96d6637afc40" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-066601e8-9f1e-4fee-bd85-96d6637afc40" acquired by "delete_volume" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[74273435-6667-45f4-a143-0ec12d9411b8]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:09 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:10 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f" returned: 0 in 0.439s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:10 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 Sep 07 10:06:10 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:10 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f Sep 07 10:06:10 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:10 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6.b7bf8118-a32b-4f32-b376-9645930c844f" returned: 0 in 0.284s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:10 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-b7bf8118-a32b-4f32-b376-9645930c844f" released by "_delete_snapshot" :: held 1.643s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40" returned: 0 in 0.452s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-2d2799de-6135-46e1-8e89-dd618f4aadb6" released by "delete_snapshot" :: held 1.682s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:10 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40 Sep 07 10:06:10 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Created reservations ['c611674e-d0ba-4f14-9ad7-91430338498d', '48f048c2-515e-43f9-98e7-14f2553526ae', 'e95eb76c-d56d-49ca-976d-02af95bb887b', 'b55d863f-6028-4ef9-a94b-acc59dff7af3'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:10 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-28ec21a7-dd72-411a-95c2-dcd9832f779e tempest-ProjectMemberTests-542438711 None] Lock "cinder-b7bf8118-a32b-4f32-b376-9645930c844f-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:10 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-066601e8-9f1e-4fee-bd85-96d6637afc40" returned: 0 in 0.295s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-066601e8-9f1e-4fee-bd85-96d6637afc40" released by "delete_volume" :: held 0.786s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Created reservations ['02e30b62-f751-4cc3-ae9b-230eebd32b06', 'ab782d90-865d-4c11-bf36-45736306a359', '21f756a6-5b45-43ff-80f2-559c0eb43d2e', '883c3da1-6010-49f5-bb8d-e5d2ff78c24f'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:10 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:10 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-2d2799de-6135-46e1-8e89-dd618f4aadb6-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Lock "cinder-2d2799de-6135-46e1-8e89-dd618f4aadb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:10 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-2d2799de-6135-46e1-8e89-dd618f4aadb6" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-2d2799de-6135-46e1-8e89-dd618f4aadb6" acquired by "delete_volume" :: waited 0.032s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff469709-a1c5-48fc-9d32-d2ca9ca4a90b]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:11 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 Sep 07 10:06:11 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:11 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.339s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:11 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Deleted volume successfully. Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5353bd19-e2da-45fd-adb6-f56202790b1a tempest-ProjectReaderTests-2056182684 None] Lock "cinder-066601e8-9f1e-4fee-bd85-96d6637afc40-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:11 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:11 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6 Sep 07 10:06:11 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (4c6c52d0-1057-4d62-9138-04280af23722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a3b884-9580-4e65-bc19-c69ca18fbc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a3b884-9580-4e65-bc19-c69ca18fbc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225558881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3da230-ced1-4380-8ec3-c8a8cf996bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:12Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf95a372-51ea-44b1-a604-ff0c4ca4293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf95a372-51ea-44b1-a604-ff0c4ca4293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecab5c78-a7c7-4773-baff-b3c63b46f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecab5c78-a7c7-4773-baff-b3c63b46f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3da230-ced1-4380-8ec3-c8a8cf996bb4', 'volume_name': 'volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4b577a-478c-4803-b386-da22a5ce3f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4b577a-478c-4803-b386-da22a5ce3f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824bf05e-b3b5-42f2-9822-4f0c8a128411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:11 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Volume 5a3da230-ced1-4380-8ec3-c8a8cf996bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4', 'volume_size': 1} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225558881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3da230-ced1-4380-8ec3-c8a8cf996bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:12Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Creating volume 5a3da230-ced1-4380-8ec3-c8a8cf996bb4 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:11 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:11 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 1073741824 Sep 07 10:06:11 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:11 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-2d2799de-6135-46e1-8e89-dd618f4aadb6" returned: 0 in 0.274s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-2d2799de-6135-46e1-8e89-dd618f4aadb6" released by "delete_volume" :: held 0.760s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Created reservations ['d50f9177-8727-41af-b912-e378066513c3', 'f975b75a-2feb-47c3-83d2-55d6763ab482', '075e4ad9-9510-41a5-b846-a935f90402a8', '9e8a2b47-dc34-467b-b1d8-4dfd5bf7bdc9'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:11 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:11 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:11 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:12 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.275s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4b8d7196-0149-453d-9666-ab8332ea861c tempest-ProjectMemberTests-542438711 None] Lock "cinder-2d2799de-6135-46e1-8e89-dd618f4aadb6-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:12 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 1073741824" returned: 0 in 0.509s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:12 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 Sep 07 10:06:12 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:12 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824bf05e-b3b5-42f2-9822-4f0c8a128411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cef0556-3920-47f6-b88f-7ace51e95a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Volume volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 (5a3da230-ced1-4380-8ec3-c8a8cf996bb4): created successfully Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cef0556-3920-47f6-b88f-7ace51e95a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (4c6c52d0-1057-4d62-9138-04280af23722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:12 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-8c93e1fd-9d73-4ff9-b95b-ee9ba250facb tempest-ProjectReaderTests-2056182684 None] Created volume successfully. Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (9d75fa3b-5872-42f2-aed2-ff36ff5bae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a81471-0def-4908-9d58-793e324e6d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a81471-0def-4908-9d58-793e324e6d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-196632337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71339d0-f575-4fad-9d01-c40ecf4b90cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:13Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbbde6b-e172-4bd7-a1c3-7dc2a76c50db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbbde6b-e172-4bd7-a1c3-7dc2a76c50db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da77e964-2cf8-495c-9279-1b9b7196b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da77e964-2cf8-495c-9279-1b9b7196b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71339d0-f575-4fad-9d01-c40ecf4b90cf', 'volume_name': 'volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbc2a30-ac06-45fb-a865-613b526d50fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbc2a30-ac06-45fb-a865-613b526d50fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8fec27-46aa-48ab-9938-bfee5ccc2201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:12 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Volume b71339d0-f575-4fad-9d01-c40ecf4b90cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf', 'volume_size': 1} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-196632337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71339d0-f575-4fad-9d01-c40ecf4b90cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:13Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Creating volume b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:12 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:12 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:12 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf 1073741824 Sep 07 10:06:12 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:13 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf 1073741824" returned: 0 in 0.413s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:13 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf Sep 07 10:06:13 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:13 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf" returned: 0 in 0.248s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8fec27-46aa-48ab-9938-bfee5ccc2201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed62297c-e509-446f-afec-4a7ac2404da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:13 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Volume volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf (b71339d0-f575-4fad-9d01-c40ecf4b90cf): created successfully Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed62297c-e509-446f-afec-4a7ac2404da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (9d75fa3b-5872-42f2-aed2-ff36ff5bae49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:13 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-462aa8eb-88e6-4ad8-919a-e8d650394b90 tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-5a3da230-ced1-4380-8ec3-c8a8cf996bb4-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-5a3da230-ced1-4380-8ec3-c8a8cf996bb4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-quobyte-5a3da230-ced1-4380-8ec3-c8a8cf996bb4" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Creating offline snapshot e49acd71-8ed3-47e9-90c1-c2a4d9369de5 of volume b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-5a3da230-ced1-4380-8ec3-c8a8cf996bb4" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a632b415-ea60-45c4-ad1c-6e751b5a1e62]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[5005ac70-afa9-4bbf-a0f8-5711fc198f28]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:13 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:14 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf Sep 07 10:06:14 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:14 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 Sep 07 10:06:14 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:14 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf" returned: 0 in 0.390s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:14 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4" returned: 0 in 0.385s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:14 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 1G Sep 07 10:06:14 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:14 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4 Sep 07 10:06:14 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:14 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-5a3da230-ced1-4380-8ec3-c8a8cf996bb4" returned: 0 in 0.251s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-5a3da230-ced1-4380-8ec3-c8a8cf996bb4" released by "delete_volume" :: held 0.690s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Created reservations ['e03ba5ce-a43b-4df3-b6e8-cf089c3765d6', '1180892d-7f29-4213-97a7-b72b767b4039', 'ee6b48e1-f1a1-467f-b93c-41e0bfa3721a', 'e877a7f5-50a0-4426-a735-a0df1f00cec4'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:14 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 1G" returned: 0 in 0.416s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:14 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:14 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:14 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 Sep 07 10:06:14 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:14 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.291s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:14 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:14 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Deleted volume successfully. Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-4f9251b5-38d8-4590-bcfa-19d86cd00f70 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-5a3da230-ced1-4380-8ec3-c8a8cf996bb4-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:15 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5" returned: 0 in 0.336s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:15 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 is being set with open permissions: ugo+rw Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:15 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 Sep 07 10:06:15 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:15 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5" returned: 0 in 0.306s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:15 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.info Sep 07 10:06:15 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (a93d2c1c-b796-4f7a-b033-6429149f96e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69fb6db-f14e-4cc3-931f-7e5934c86093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69fb6db-f14e-4cc3-931f-7e5934c86093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615531919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e333698-f361-4a9c-9a75-b9d473e54f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:15Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac6d7db-64be-4616-8bc8-a6fca0c33f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac6d7db-64be-4616-8bc8-a6fca0c33f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71accb4c-f2ea-47fa-ab9f-34389bb333c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71accb4c-f2ea-47fa-ab9f-34389bb333c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e333698-f361-4a9c-9a75-b9d473e54f63', 'volume_name': 'volume-8e333698-f361-4a9c-9a75-b9d473e54f63', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133ce8ae-178e-49ad-9311-a3b4970824cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133ce8ae-178e-49ad-9311-a3b4970824cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701ef230-0b0f-4a8a-8328-9c69bf3b6378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:15 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Volume 8e333698-f361-4a9c-9a75-b9d473e54f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e333698-f361-4a9c-9a75-b9d473e54f63', 'volume_size': 1} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:15 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.info" returned: 0 in 0.261s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:15 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.info is being set with open permissions: ugo+rw Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:15 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.info Sep 07 10:06:15 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:15 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.info" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615531919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e333698-f361-4a9c-9a75-b9d473e54f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902ff9eabd240acbb38c8677c2dc2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:15Z,use_quota=True,user_id='4705fda47daf49ed8fd519663919771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Creating volume 8e333698-f361-4a9c-9a75-b9d473e54f63 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:15 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:15 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:15 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 1073741824 Sep 07 10:06:15 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:15 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-29ec0724-2af3-4f5b-973e-e41caed79827 tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:06:16 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 1073741824" returned: 0 in 0.418s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:16 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 Sep 07 10:06:16 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:16 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701ef230-0b0f-4a8a-8328-9c69bf3b6378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e333698-f361-4a9c-9a75-b9d473e54f63', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee8ef47-9bed-49e2-882d-fc49d80e0e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:16 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Volume volume-8e333698-f361-4a9c-9a75-b9d473e54f63 (8e333698-f361-4a9c-9a75-b9d473e54f63): created successfully Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee8ef47-9bed-49e2-882d-fc49d80e0e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Flow 'volume_create_manager' (a93d2c1c-b796-4f7a-b033-6429149f96e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:16 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5ad2cfcf-3518-4e3d-beca-678694f012b6 tempest-ProjectReaderTests-2056182684 None] Created volume successfully. Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-e49acd71-8ed3-47e9-90c1-c2a4d9369de5-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Lock "cinder-e49acd71-8ed3-47e9-90c1-c2a4d9369de5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-b71339d0-f575-4fad-9d01-c40ecf4b90cf" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-b71339d0-f575-4fad-9d01-c40ecf4b90cf" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:16 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-e49acd71-8ed3-47e9-90c1-c2a4d9369de5" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-e49acd71-8ed3-47e9-90c1-c2a4d9369de5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot e49acd71-8ed3-47e9-90c1-c2a4d9369de5 of volume b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0944163a-a43f-4b9b-9d81-e1639200c3fa]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:17 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 Sep 07 10:06:17 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:17 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5" returned: 0 in 0.389s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bb60cd-6136-4b27-a3be-208bffc8acae]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-8e333698-f361-4a9c-9a75-b9d473e54f63-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-8e333698-f361-4a9c-9a75-b9d473e54f63-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "cinder-quobyte-8e333698-f361-4a9c-9a75-b9d473e54f63" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:17 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf Sep 07 10:06:17 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-8e333698-f361-4a9c-9a75-b9d473e54f63" acquired by "delete_volume" :: waited 0.017s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa9f535-2284-4569-9a75-46cc24daa860]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:17 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 Sep 07 10:06:17 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:17 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf" returned: 0 in 0.375s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:17 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 Sep 07 10:06:17 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:17 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63" returned: 0 in 0.378s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:17 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:18 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63 Sep 07 10:06:18 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:18 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5" returned: 0 in 0.322s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:18 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5 Sep 07 10:06:18 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:18 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-8e333698-f361-4a9c-9a75-b9d473e54f63" returned: 0 in 0.258s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-quobyte-8e333698-f361-4a9c-9a75-b9d473e54f63" released by "delete_volume" :: held 0.673s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Created reservations ['add588cc-7c77-491e-9fdb-6f820922191c', 'b3c780e7-a6c0-4324-9b06-e9f82d6562fd', 'ed3277f6-bb6b-46b7-8a93-ae2dc47c425c', '3e1e14e8-2885-4fc9-b720-0c00a359968e'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:18 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:18 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:18 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf.e49acd71-8ed3-47e9-90c1-c2a4d9369de5" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-e49acd71-8ed3-47e9-90c1-c2a4d9369de5" released by "_delete_snapshot" :: held 1.437s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-b71339d0-f575-4fad-9d01-c40ecf4b90cf" released by "delete_snapshot" :: held 1.461s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Created reservations ['2d59a6c3-70f4-447d-a6d8-f85696774ee7', 'd0799265-4b26-499e-b6ae-4993a6f89b37', '91ef7fe1-5f20-4855-90d6-57eb5b3995a5', 'cbc16d08-a107-4bb0-9298-036666e24f8c'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-d91ecb05-2226-4768-8e88-1f9c7ed25d4d tempest-ProjectMemberTests-542438711 None] Lock "cinder-e49acd71-8ed3-47e9-90c1-c2a4d9369de5-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:18 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.257s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:18 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Deleted volume successfully. Sep 07 10:06:18 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-bd6953be-e97b-47ca-82b2-3b087241e0b9 tempest-ProjectReaderTests-2056182684 None] Lock "cinder-8e333698-f361-4a9c-9a75-b9d473e54f63-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-b71339d0-f575-4fad-9d01-c40ecf4b90cf-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Lock "cinder-b71339d0-f575-4fad-9d01-c40ecf4b90cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-b71339d0-f575-4fad-9d01-c40ecf4b90cf" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-b71339d0-f575-4fad-9d01-c40ecf4b90cf" acquired by "delete_volume" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119880f-9368-4ac3-a074-0994171e18cf]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:19 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf Sep 07 10:06:19 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:19 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf" returned: 0 in 0.380s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:19 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf Sep 07 10:06:19 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:19 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-b71339d0-f575-4fad-9d01-c40ecf4b90cf" returned: 0 in 0.257s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-b71339d0-f575-4fad-9d01-c40ecf4b90cf" released by "delete_volume" :: held 0.699s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:19 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Created reservations ['0c5e0d07-0e1e-441d-9cde-338350249dd3', 'e0ace381-4ff0-4c19-8125-494140160074', '063a213b-6adf-4767-a616-be72e9edfb2a', '6d79daa8-468f-4e72-ad37-3af37821a577'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:20 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:20 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:20 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.273s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:20 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-5877fe76-6d17-445b-8971-f47a88e85db7 tempest-ProjectMemberTests-542438711 None] Lock "cinder-b71339d0-f575-4fad-9d01-c40ecf4b90cf-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (d510869b-0b85-4258-b531-8fbc7473abdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0214f6-568a-41f5-ace6-9a533489901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0214f6-568a-41f5-ace6-9a533489901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494564343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc51b64-893f-4d98-b795-854c42f766c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:21Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094740a9-114b-4221-90ac-a0664042578d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094740a9-114b-4221-90ac-a0664042578d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64686dc-88d1-41ff-98a4-cd9f043f4248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64686dc-88d1-41ff-98a4-cd9f043f4248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc51b64-893f-4d98-b795-854c42f766c3', 'volume_name': 'volume-bbc51b64-893f-4d98-b795-854c42f766c3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16a4ba4-5dd7-4fd4-a800-7791c71c0b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16a4ba4-5dd7-4fd4-a800-7791c71c0b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e55665c-9d25-4f74-b7fb-a28f18b2a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Volume bbc51b64-893f-4d98-b795-854c42f766c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc51b64-893f-4d98-b795-854c42f766c3', 'volume_size': 1} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494564343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc51b64-893f-4d98-b795-854c42f766c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:21Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Creating volume bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:20 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:20 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:20 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 1073741824 Sep 07 10:06:20 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:21 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 1073741824" returned: 0 in 0.417s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:21 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 Sep 07 10:06:21 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:21 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e55665c-9d25-4f74-b7fb-a28f18b2a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc51b64-893f-4d98-b795-854c42f766c3', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60f4727-46a0-4094-bc3d-a8e756f9ff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:21 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Volume volume-bbc51b64-893f-4d98-b795-854c42f766c3 (bbc51b64-893f-4d98-b795-854c42f766c3): created successfully Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60f4727-46a0-4094-bc3d-a8e756f9ff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (d510869b-0b85-4258-b531-8fbc7473abdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:21 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-6720aa1c-08bd-4f7e-ab61-6bd6cf933203 tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Creating offline snapshot e9690155-fa4c-4f0c-bf50-30433428ba06 of volume bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b4f098-8035-40bf-94f4-afdabc8a29e1]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:21 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:22 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 Sep 07 10:06:22 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:22 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3" returned: 0 in 0.352s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:22 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 1G Sep 07 10:06:22 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:22 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 1G" returned: 0 in 0.374s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc51b64-893f-4d98-b795-854c42f766c3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:22 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc51b64-893f-4d98-b795-854c42f766c3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 Sep 07 10:06:22 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:22 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc51b64-893f-4d98-b795-854c42f766c3 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06" returned: 0 in 0.278s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:22 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 is being set with open permissions: ugo+rw Sep 07 10:06:22 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:22 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 Sep 07 10:06:22 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:23 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06" returned: 0 in 0.247s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:23 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.info Sep 07 10:06:23 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:23 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.info" returned: 0 in 0.239s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:23 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.info is being set with open permissions: ugo+rw Sep 07 10:06:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:23 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.info Sep 07 10:06:23 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:23 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.info" returned: 0 in 0.238s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:23 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:23 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-742b63a8-41e7-4e05-be07-34f099b40f7d tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-e9690155-fa4c-4f0c-bf50-30433428ba06-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Lock "cinder-e9690155-fa4c-4f0c-bf50-30433428ba06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-bbc51b64-893f-4d98-b795-854c42f766c3" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-bbc51b64-893f-4d98-b795-854c42f766c3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-e9690155-fa4c-4f0c-bf50-30433428ba06" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-e9690155-fa4c-4f0c-bf50-30433428ba06" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot e9690155-fa4c-4f0c-bf50-30433428ba06 of volume bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23cb129-cd26-44a1-8b10-d146ece0d556]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:24 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 Sep 07 10:06:24 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:24 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06" returned: 0 in 0.352s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc51b64-893f-4d98-b795-854c42f766c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3b7703-3c18-473f-859d-8c16c9b77e3a]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:24 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 Sep 07 10:06:24 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:24 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3" returned: 0 in 0.346s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:24 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:24 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 Sep 07 10:06:24 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:25 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06" returned: 0 in 0.329s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:25 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06 Sep 07 10:06:25 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:25 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:25 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3.e9690155-fa4c-4f0c-bf50-30433428ba06" returned: 0 in 0.235s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-e9690155-fa4c-4f0c-bf50-30433428ba06" released by "_delete_snapshot" :: held 1.355s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-bbc51b64-893f-4d98-b795-854c42f766c3" released by "delete_snapshot" :: held 1.377s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:25 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Created reservations ['d323877b-cf5a-4383-b935-c50d990c907d', '670cebff-b7ea-48ab-8494-2a13c8e32600', '30e03646-da04-4bae-a626-9bee32a326c0', '50d4a5bc-21cb-4550-b539-5eb0d4d38526'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:25 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:06:25 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-33673477-70e7-480a-a24f-ee1fe860ccda tempest-ProjectMemberTests-542438711 None] Lock "cinder-e9690155-fa4c-4f0c-bf50-30433428ba06-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-bbc51b64-893f-4d98-b795-854c42f766c3-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Lock "cinder-bbc51b64-893f-4d98-b795-854c42f766c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-bbc51b64-893f-4d98-b795-854c42f766c3" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-bbc51b64-893f-4d98-b795-854c42f766c3" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e2542f-d7b9-404f-8f86-40fc3c46532f]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:26 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 Sep 07 10:06:26 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:26 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3" returned: 0 in 0.343s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:26 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3 Sep 07 10:06:26 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:26 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-bbc51b64-893f-4d98-b795-854c42f766c3" returned: 0 in 0.238s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-bbc51b64-893f-4d98-b795-854c42f766c3" released by "delete_volume" :: held 0.636s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:26 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Created reservations ['30d326b6-a061-4f29-bd8c-e861a32ee19d', '9d78a0df-73fe-41a3-a744-19c9687a416e', '599a6655-b62d-4f81-81d8-51609fcc2274', 'f22bcd85-6fa8-4f40-89cf-7ef88f92d842'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:27 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:27 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:27 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.236s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:27 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-36b2ad04-ddef-4088-ac6f-4489b0b87d7e tempest-ProjectMemberTests-542438711 None] Lock "cinder-bbc51b64-893f-4d98-b795-854c42f766c3-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.flows.manager.create_volume [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87290) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (d0917e22-8109-4861-9089-d056861015c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c7aefc-112e-4964-9b8a-7b54e4c3d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c7aefc-112e-4964-9b8a-7b54e4c3d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863082375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d8307a-893d-4492-8336-32aca5d02a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:28Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f2a35-d704-4e33-8ee6-eb738b3e3235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f2a35-d704-4e33-8ee6-eb738b3e3235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82478f2-57f1-460b-aab8-dd60dd5bfb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82478f2-57f1-460b-aab8-dd60dd5bfb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d8307a-893d-4492-8336-32aca5d02a32', 'volume_name': 'volume-c8d8307a-893d-4492-8336-32aca5d02a32', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2e84ee-2178-43b9-9e83-5b752af685b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2e84ee-2178-43b9-9e83-5b752af685b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c128f6f-5974-44af-8343-3ae20802f850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:27 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Volume c8d8307a-893d-4492-8336-32aca5d02a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d8307a-893d-4492-8336-32aca5d02a32', 'volume_size': 1} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863082375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d8307a-893d-4492-8336-32aca5d02a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76a1e7155cf499c9f8e6629122766d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:28Z,use_quota=True,user_id='0cb4e39267bf472788bd879f14a46e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dfd7f4e-884a-4059-8f10-44ddbb6cae7e),volume_type_id=3dfd7f4e-884a-4059-8f10-44ddbb6cae7e)}" {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Creating volume c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 as target Quobyte volume. {{(pid=87290) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:27 devstack cinder-volume[87290]: INFO cinder.volume.drivers.remotefs [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4 Sep 07 10:06:27 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 1073741824 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:27 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 1073741824 Sep 07 10:06:27 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:28 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 1073741824" returned: 0 in 0.409s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:28 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 Sep 07 10:06:28 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:28 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32" returned: 0 in 0.256s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'} {{(pid=87290) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c128f6f-5974-44af-8343-3ae20802f850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d8307a-893d-4492-8336-32aca5d02a32', 'volume_size': 1}' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9ce381-6a3b-4e2d-bb83-591f6833fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:28 devstack cinder-volume[87290]: INFO cinder.volume.flows.manager.create_volume [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Volume volume-c8d8307a-893d-4492-8336-32aca5d02a32 (c8d8307a-893d-4492-8336-32aca5d02a32): created successfully Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9ce381-6a3b-4e2d-bb83-591f6833fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87290) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Flow 'volume_create_manager' (d0917e22-8109-4861-9089-d056861015c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87290) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:28 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-2108a1e5-52df-423a-88e5-16fb58a64e40 tempest-ProjectMemberTests-542438711 None] Created volume successfully. Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Creating offline snapshot 6a45595f-45e9-4f7d-9379-4557fd8d5637 of volume c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[356ebe09-8a17-47e2-83ae-fc09c0a40972]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:28 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:29 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 Sep 07 10:06:29 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:29 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32" returned: 0 in 0.361s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 1G {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:29 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 1G Sep 07 10:06:29 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:29 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 1G" returned: 0 in 0.379s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:29 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8d8307a-893d-4492-8336-32aca5d02a32 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:29 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8d8307a-893d-4492-8336-32aca5d02a32 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 Sep 07 10:06:29 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8d8307a-893d-4492-8336-32aca5d02a32 -F qcow2 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637" returned: 0 in 0.292s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 is being set with open permissions: ugo+rw Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:30 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 Sep 07 10:06:30 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637" returned: 0 in 0.236s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:30 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.info Sep 07 10:06:30 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.info" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87290]: WARNING cinder.volume.drivers.remotefs [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.info is being set with open permissions: ugo+rw Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.info {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:30 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.info Sep 07 10:06:30 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.info" returned: 0 in 0.236s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:30 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-f37ab02d-430d-4d79-959a-7adef9ec691b tempest-ProjectMemberTests-542438711 None] Create snapshot completed successfully Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-6a45595f-45e9-4f7d-9379-4557fd8d5637-delete_snapshot" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Lock "cinder-6a45595f-45e9-4f7d-9379-4557fd8d5637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-c8d8307a-893d-4492-8336-32aca5d02a32" by "delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-c8d8307a-893d-4492-8336-32aca5d02a32" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-6a45595f-45e9-4f7d-9379-4557fd8d5637" by "_delete_snapshot" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-6a45595f-45e9-4f7d-9379-4557fd8d5637" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Deleting offline snapshot 6a45595f-45e9-4f7d-9379-4557fd8d5637 of volume c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] snapshot_file for this snap is: volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 {{(pid=87290) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdac83b-f3ee-4e10-8835-3bd850aff7b4]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:31 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 Sep 07 10:06:31 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:31 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637" returned: 0 in 0.357s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.remotefs [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8d8307a-893d-4492-8336-32aca5d02a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87290) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[27847ffd-2954-4d10-b102-6b9a7c0d7ece]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:31 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:31 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 Sep 07 10:06:31 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:31 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32" returned: 0 in 0.349s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:32 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 Sep 07 10:06:32 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:32 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637" returned: 0 in 0.322s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:32 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637 Sep 07 10:06:32 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:32 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32.6a45595f-45e9-4f7d-9379-4557fd8d5637" returned: 0 in 0.237s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-6a45595f-45e9-4f7d-9379-4557fd8d5637" released by "_delete_snapshot" :: held 1.351s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-c8d8307a-893d-4492-8336-32aca5d02a32" released by "delete_snapshot" :: held 1.379s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Created reservations ['e6600180-f5fb-4ab7-81d4-2107121eeea6', '797e8d1a-16e1-4fd4-9d99-e38971643df8', '1944b992-a21d-453c-8b90-ec60c590a032', '170d31db-7bb0-4faa-a0a3-2a2f7ddf79a6'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:32 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Delete snapshot completed successfully. Sep 07 10:06:32 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-0ae3613b-32e1-4ad3-923c-6f60e14d6ba4 tempest-ProjectMemberTests-542438711 None] Lock "cinder-6a45595f-45e9-4f7d-9379-4557fd8d5637-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-c8d8307a-893d-4492-8336-32aca5d02a32-delete_volume" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Lock "cinder-c8d8307a-893d-4492-8336-32aca5d02a32-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Acquiring lock "cinder-quobyte-c8d8307a-893d-4492-8336-32aca5d02a32" by "delete_volume" {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-c8d8307a-893d-4492-8336-32aca5d02a32" acquired by "delete_volume" :: waited 0.014s {{(pid=87290) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d595c8c-3de2-4e6f-967e-d019cad2c6bb]: (4, 'qcow2') {{(pid=88436) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:33 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 Sep 07 10:06:33 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:33 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32" returned: 0 in 0.340s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:33 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:33 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32 Sep 07 10:06:33 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:33 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5/volume-c8d8307a-893d-4492-8336-32aca5d02a32" returned: 0 in 0.231s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Lock "cinder-quobyte-c8d8307a-893d-4492-8336-32aca5d02a32" released by "delete_volume" :: held 0.622s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG cinder.quota [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Created reservations ['cf10bc8b-fbf6-433c-8673-64d078a0ea95', 'c919cf4e-1aa9-4c5f-80ed-6df9e7f8bae2', '44841898-c955-4d5e-9971-e29cee40a239', '9c03be7b-fd57-4db2-b7e8-c1ce0da58697'] {{(pid=87290) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:34 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:34 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:34 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.233s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:34 devstack cinder-volume[87290]: INFO cinder.volume.manager [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Deleted volume successfully. Sep 07 10:06:34 devstack cinder-volume[87290]: DEBUG cinder.coordination [None req-14120d6a-ab45-46a7-84ed-05c5a01a3fe8 tempest-ProjectMemberTests-542438711 None] Lock "cinder-c8d8307a-893d-4492-8336-32aca5d02a32-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87290) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4': None} {{(pid=87290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG cinder.volume.drivers.quobyte [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed64e0f4-50bf-483e-b4f9-405d2125e8b4'] {{(pid=87290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.lockutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:41 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5 Sep 07 10:06:41 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:41 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG oslo_concurrency.processutils [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3a99d77cf43cb020c81936719886bde5" returned: 0 in 0.243s {{(pid=87290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG cinder.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Notifying Schedulers of capabilities ... {{(pid=87290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG oslo_service.periodic_task [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] Running periodic task VolumeManager._thread_info {{(pid=87290) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread count: 28 {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:06:41 devstack cinder-volume[87290]: DEBUG cinder.volume.manager [None req-410c5078-3b64-4819-bb3d-ca913efe463b None None] thread info: [<_MainThread(MainThread, started 129421385658496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87290) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:06:44 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=73,cinder:INSERT=28,cinder:UPDATE=100,cinder:DELETE=8 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:06:44 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=99,cinder:DELETE=8,cinder:SELECT=69,cinder:INSERT=25 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:06:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:SELECT=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:06:57 devstack cinder-volume[87290]: DEBUG dbcounter [-] [87290] Writing DB stats cinder:UPDATE=1 {{(pid=87290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}